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Abstract. In the supermarket model, there are n queues, each with 
a single server. Customers arrive in a Poisson process with arrival rate 
An, where A = A(n) £ (0, 1). Upon arrival, a customer selects d — d{n) 
servers uniformly at random, and joins the queue of a least-loaded server 
amongst those chosen. Service times are independent exponentially dis- 
tributed random variables with mean 1. In this paper, we analyse the 
behaviour of the supermarket model in a regime where A(n) tends to 1, 
and d{n) tends to infinity, as n — >■ oo. For suitable triples (n,d. A), we 
identify a subset N of the state space where the process remains for a 
long time in equilibrium. We further show that the process is rapidly 
mixing when started in A/", and give bounds on the speed of mixing for 
more general initial conditions. 



1. Introduction 

The supermarket model is a Markov chain model for a dynamic load- 
balancing process. There are n servers, and customers arrive according to 
a Poisson process with rate A = A(n) < 1. On arrival, a customer inspects 
d = d{n) queues, chosen uniformly at random with replacement, and joins 
a shortest queue among those inspected (in case of a tie, the first shortest 
queue in the list is joined). Each server serves one customer at a time, and 
service times are iid random variables, with an exponential distribution of 
mean 1. 

A number of authors [HKISllIlllSlElElElEllllI] have studied the 
supermarket model, as well as various extensions, e.g., to the setting of a 
Jackson network [9] and to a version with one queue saved in memory |131 18] . 

Previous work has concentrated on the case where A and d are held fixed 
as n tends to infinity. As with other related models, there is a dramatic 
change when d is increased from 1 to 2: if d = 1, the maximum queue length 
in equilibrium is of order logn, while if d is a constant at least 2, then the 
maximum queue length in equilibrium is of order log logn/ log d. 

Luczak and McDiarmid [5j prove that, for fixed A and d, the sequence 
of Markov chains indexed by n is rapidly mixing: as n — )• oo, the time for 
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the system to converge to equilibrium is of order logn, provided the initial 
state has not too many customers and no very long queue. Also, they show 
that, for d > 2, with probability tending to 1 as n — )• oo, in the equilibrium 
distribution the maximum queue length takes one of at most 2 values, and 
that these values are log log n/ log d + 0(1). 

Consider the infinite system of differential equations 

= X{vk-i{t)'' - Vkitf) - {vk{t) - Vk+i{t)), k > 1, (1.1) 

where fo(i) = 1 for all t. For an initial condition f (0) such that 1 > vi{0) > 
^■2(0) > ... > and ffc(O) — )• as /c — )• 00, there is a unique solution v{t) 
{t > 0), with v{t) = {vk{t))k>i, which is such that 1 > vi{t) > V2{t) > 
. . . > and Ufc(t) — )• as /c — )• 00, for each t > 0. It follows from earlier 
work [El El O El E] that, with high probability, for each k, the proportion of 
queues of length at least k at time t stays "close to" Vk{t) over a bounded time 
interval (or an interval whose length tends to infinity at most polynomially 
with n), assuming this is the case at time 0. 

The system (|l.ip has a unique, attractive, fixed point vr = {ir{k))k>i, such 
that 7r(fc) — )• as fc — )• 00, given by 

7r{k) = X^+-+'^''~\ k>l. (1.2) 

In equilibrium, with high probability, the proportion of queues of length 
at least k is close to 7r(fc) for each A; > 1, over time intervals of length 
polynomial in n; see [21 [3l [H [6] . 

In this paper, we extend the above results about equilibrium behaviour 
and rapid mixing to some regimes where A(n) — )• 1 and d{n) — )• 00 as n — )• 00. 
For A and d functions of n, there is no single limiting differential equation 
(jl.ip . but rather a sequence of approximating differential equations, each 
with their own solutions and fixed points. In this paper, we do not address 
the question of whether such approximations to the evolution of the process 
are valid in generality, focussing solely on equilibrium behaviour and the time 
to reach equilibrium. We show that, for a wide range of triples (n, d, A), the 
maximum queue length in equilibrium is equal to 



k = A;^'' 



log(l-A)^ 
logd 



over long stretches of time, with high probability. Moreover, in equilibrium, 
with high probability, most queues have length exactly k, and we are able 
to estimate precisely the numbers of queues of each smaller length. In other 
words, this is a regime where we have "nearly exact" load balancing between 
the servers. As we shall discuss later, this is still consistent with the principle 
that the proportion of queues of length at least k is close to 7r{k) for each k. 
We further prove that the mixing time from a "good" state is at most of 
order kd''~^logn, and we show that this is roughly best possible. We also 
prove general bounds on the mixing time, in terms of the initial number 
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of customers and the initial maximum queue length, and show that these 
bounds are also roughly best possible. 

We will shortly state our main results precisely, but first we describe the 
supermarket model more carefully. In fact, we describe a natural discrete- 
time version of the process, which we shall work with throughout; as is 
standard, one may convert results about the discrete time version to the 
continuous model, with the understanding that one unit of time in the con- 
tinuous model corresponds to about (1 + A)n steps of the discrete model. 

A queue-lengths vector is an n-tuple {x{l), . . . ,x{n)) whose entries are 
non-negative integers. If x(j) = i, wc say that queue j has length i, or 
that there are i customers in queue j; we think of these customers as in 
positions 1, . . . ,i in the queue. We use similar terminology throughout; for 
instance, to say that a customer arrives and joins queue j means that x{j) 
increases by 1, and to say that a customer in queue j departs or is served 
means that x{j) decreases by 1. Given a queue- lengths vector x, we write 
= J2]=i ^(i) to denote the total number of customers in state x, and 
||x||oo = maxx(j) to denote the maximum queue length in state x. 

For each i >0, and each x G Z", we define Ui{x) to be the proportion of 
queues in x with length at least i. So uo{x) = 1 for all x, and, for each fixed 
X, the Ui{x) form a non-increasing sequence of multiples of 1/n, such that 
Ui{x) = eventually. The sequence (?ij(.x))j>o captures the "profile" of a 
queue-lengths vector x, and we shall describe various sets of queue-lengths 
vectors, and functions of the queue-lengths vector, in terms of the Ui{x). 

For positive integers n and d, and A G (0, 1), we now define the (n, d, X)- 
supermarket process. This process is a discrete-time Markov chain (Xt), 
whose state space is the set Z" of queue-lengths vectors, and where transi- 
tions occur at non-negative integer times. Each transition is either a cus- 
tomer arrival, with probability A/(l + A), or a potential departure, with 
probability 1/(1 -|- A). If there is a potential departure, then a queue K 
is selected uniformly at random from {1, . . . ,n}: if there is a customer in 
queue K, then they are served and depart the system. If there is an arrival, 
then d queues are selected uniformly at random, with replacement, from 
{1, . . . ,n}, and the arriving customer joins a shortest queue among those 
selected. To be precise, a d-tuple {Ki, ... ,Kd,) is selected, and the customer 
joins queue k = Kj, where j is the least index such that x{Kj) is minimal 
among {x{Ki), x{Kd,)}. 

For a; e Z", (Xf) denotes a copy of the (n, d, A)-supermarket process 
(Xt) where Xq = x a.s., although when it is clear from the context we shall 
prefer to use the simpler notation (Xt). Throughout, we let (Yt) denote 
a copy of the process in equilibrium. Of course, the processes depend on 
the parameters (n,d. A), but we suppress this dependence in the notation. 
Throughout the paper, we use (Tt) to denote the natural filtration of the 
process {Xt). We use the notation P(-) freely to denote probability in what- 
ever space we are working in. As before, for A G (0, 1) and d G N, we set 
[log(l-A)-Vlogd]. 
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We now state our main results. First, we describe sets of queue-lengths 
vectors M^{n, d, A, k): our aim is to prove that, for suitable values of n, d and 
X, k = k^''^, and appropriately small e, an equilibrium copy of the (n, d, X)- 
supermarket process spends almost all of its time in the set J\f^{n, d, A, k). 

For e G (0, 1/10], A G (0, 1), and positive integers n, d and k, let Af^ = 
J\f^{n, d, X, k) be the set of all queue-lengths vectors x such that: Uk+i{x) = 
and, for 1 < j < /c, 

(1 - 5e)(l - X){Xdy-^ < 1 - Uj{x) < (1 + 5e)(l - X){Xdy-^. 

So, for X G AA^, we have the following. 

(a) There are no queues of length /c + 1 or greater. 

(b) For 1 < j < A:, the number of queues of length less than j is n(l — 
Uj{x)), which lies between (1 — 5£)n{l — X){Xdy^^ and (l + 5e)n(l — 

x){xdy-K 

(c) In particular, the number of queues of length less than k is at most 
(1 + 5e)n{l — X){Xd)^~^ . We shall work under assumptions guar- 
anteeing that ^'^^-'^(1 — A) — )• as n — )• oo, so that the number of 
queues of length less than k is o(n), and so the proportion of queues 
of length exactly k tends to 1 as n — )• oo. 

(d) For 1 < J < A; — 1, the number of queues of length exactly j is 
n{uj{x) — Uj-^.l{x)). Provided eXd > 2, this quantity lies between 
(1 - 6e)n(l - X){Xdy and (1 + 6e)n(l - X){Xdy . 

Theorem 1.1. For each e > 0, there exists C such that the following holds 
for all sufficiently large n, and all X with 

Vn Clog n 

For each positive integer d with {1 — X)^^ > d> ACkx^d^o^ n and 

1/, /n i/c^A.d-i) 



(2(i-ArMog^n)--'''<d< ["^ckzr) ' ^^-^^ 

a copy (Yt) of the [n^d^X)- supermarket process in equilibrium satisfies 
'3te[0,e'^'''^'%Yt(^M%n,d,X,kx,d)) <e--^'°^"^. 



Observe that, from the definition of kx^d-, we have d^^-'^ ^ < (1 — A) ^ < 
(^fcA.d. We interpret (fOj) as saying that these inequalities are true with some- 
thing to spare. In other words, (jl.3p will hold whenever log(l — X)~^ / logd 
is not too close to an integer. If that is the case, then the conclusion of the 
theorem implies that, for the (n, d, A)-supermarket process in equilibrium, 
with high probability the maximum queue length is kx^d and most queues 
have exactly this length. 

In fact, we shall prove the following result, which - as we shall show — 
implies Theorem I l.li 
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Theorem 1.2. Suppose the natural numbers n, d and k, and the real num- 
bers A and e in (0, 1) satisfy: k > 2, d^{l — A) > 21og^ n, 

1 i I50k . 1 10\/6A;logn(l - A)"0 

Then a copy (Yt) of the {n, d, X) -supermarket process in equilibrium satisfies 
'3te [0,e^^"^''^],Yt^Af'{n,d,X,k)) <e-3'°s'". 



On the surface, this theorem may appear to apply for every value of n; 
however, the conditions above can only be satisfied if n is at least 10^^. 
This, as well as other consequences of the assumptions above, is shown in 
Lemma 16.11 



Proof of Theorem In order to prove Theorem II. 1) we may assume that 
e < 1/10. We shall show that, given e G (0, 1/10], a suitable C can be found 
so that, whenever n, d and A satisfy the assumptions of Theorem I l.H then 
(n, d, kx^d, ^T^) satisfies all the conditions of Theorem 11.21 

The conditions (i'^'^''*(l — A) > 21og^n and k\^d > 2 (which is equiva- 
lent to (1 — A)~^ > d) follow automatically from the assumptions of The- 
orem [TTTJ We also have, directly from the second inequality in ()1.3p . that 
e > 100A;A,d(l - A)d'=^ ''~\ provided we choose C > lOOe"^ 

To see the remaining conditions, we first note that kx^d ^ log(l — A)^^ < 
logn, for n sufficiently large: the first inequality is from the definition of 
kx^d and the second is from the lower bound on 1 — A, for n sufficiently large. 

Now eVd > 2ey^Ck^logn > 2eVCkl[^, using the lower bound on d. We 

now deduce that e^/d > 150k, provided VC > 75e~^ . 

Finally < ^ J^a^ , and kx^ < logn, so 

10VQkxdlogn(l- \)-^ 1 , 10\/61ogn 10^/6 

'■ ■;= < o — logn — = — < e, 

Clog^n ^/d CVd 

provided C > 10V6e-^ 

In summary, provided we choose C > 75^e~^, all the conditions of Theo- 
rem [L2] are satisfied. □ 

The conditions d''{l - A) > 21og^n and 100A;(1 - X)d^~^ < e imply 
that d > 200e~^A; log^ n. Provided (1 — A)~^ is large compared with log^n, 
"most" values of d above this minimum fall into one of the ranges between 

(2(1 — A)~^ log^ n) and ( j , with only small transitional 

ranges around (1 — A)^^/'^, for k an integer, left uncovered by the result. 

For values of d in these transitional ranges, our results say nothing. How- 
ever, in these ranges, we can make use of a coupling result in [14] (see 
also [2]). For d < d' , there is a coupling of the (n, d' , A)-supermarket process 
and the (n, d, A)-supermarket process such that, for all times t > 0, and 
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for each j, the number of customers in position at least j in their queue 
at time t in the {n,d', A)-supermarket process is at most the corresponding 
number in the (n, d, A)-supermarket process, provided this is true at time 0. 
This imphes that, in equihbrium, the number of customers in position at 
least j in the (n, d', A)-supermarket process in equilibrium is stochastically 
at most the corresponding number in the (n, d, A)-supermarket process. For 
instance, if in the equilibrium (n, d, A)-supermarket process, the maximum 
queue length is at most k with high probability, then the same is true for 
the equilibrium (n, d', A)-supermarket process. 

Also, if A < A', then there is a coupling of the {n,d,X)- and {n,d,X')- 
supermarket processes, so that at each time, each queue in the (n, d, A)- 
supermarket process is no longer than in the (n, d, A')-supermarket process, 
provided this is true at time 0. So, for instance, if at a given time there are at 
least m queues with length k in the (n, d, A)-supermarket process, then there 
are also at least m queues with length at least k in the (n, d, A')-supermarket 
process. 

To illustrate our results in some special cases, first suppose A = A(n) = 
1 — and d = n^, for some real numbers a, /3 S (0, 1); then kx^d = [a//?! • 
It is easy to check that the conditions of Theorem 11.21 are satisfied with 
k = kx fi and e = , provided: a//3 is not an integer, a > (3 (so that 
A; > 2), 2a < 1 + /3 (so that (1 - X)-^/Vnd = n'^-i'^+l^y^ tends to zero), and 



< mm — , 
2 



/3 — a, a 



2 

provided n is sufficiently large. The conclusions of Theorem II . 2 1 then hold, so 
in equilibrium the process spends almost all of the time in A/"^ = A/'^(n, d, A, k). 
For X £ AA^, the maximum queue-length is k, and the number of queues of 
length less than k is given by n(l — nfc(a;)), which lies between 

(1 - 5n-^)ni-"+L"//3J/3 ^nd (1 + 5n-^K-°+L-//3J/3 

If a//3 is equal to an integer k > 2, then we cannot expect as strong a 
conclusion to hold. However, by comparing with the process for slightly 
lower, and slightly higher, values of A, we see that the maximum queue 
length in equilibrium is a.s. either k or k + 1, and that most queues have 
length either k or k + 1. 

If we take A = 1 — n~" for some constant a G (0, 1/2), and d tending to 
infinity more slowly than a power of n, but with d > C log^ n/ log log n for a 
suitably large constant C, then again Theorem 11.21 applies, with k = kx^d = 
[log(l — X)~^/\ogd~\ = [a log n/ log , provided that a log n/ log d is not 
too close to an integer. In this case, kx,d tends to infinity with n, and can 
be as large as (q/3 — 5) logn/loglogn, for 5 any positive constant and n 
sufficiently large. Specifically, suppose that k = 7 log n/ log log n, with 7 < 
a/3. Then it is straightforward to check that the conditions of Theorem ll.2l 
are satisfied if d = (log n)(°+^i°gi°s "/i°s which is equivalent to d^ = 
n°(logn)^, for 2 < 6 < a/7 — 1. Here we can take e to be (logn)^"^ for a 
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small enough 6. In this range, even though k is fairly large, the conclusion 
is that, with high probability in equilibrium, almost all queues have length 
exactly k, and there are no longer queues. 

Next, suppose A = 1 — (logn)~°, for some fixed a > 2. For such a 
value of A, Theorem 11.21 requires that d > 200e~^A; log^ n > log^n, and 
that d'^^i < e(l - X)~^/100k < (1 - X)'^ = (logn)", which implies that 
a/{k - 1) < 2, or fc < + 1. 

In other words, for such values of A, we only have results giving conditions 
under which the maximum queue length k = k\ ,i is a constant, with 2 < 
/c < |a + 1. If d = (logn)^, where (a + 2)/k < (3 < a/{k - 1), then the 
conditions of Theorem 11.21 do apply for sufficiently large n, where we may 
take e = (logn)"'' for a suitably small 6. 

lie < 1/10 and A = 1 - , for C > IGOOOOe^^ and d = clog^ n, for 

— ' C log^ n ' ' o ) 

\/2C < c < eC/200, then the conditions of Theorem 11.21 apply for k = 2 
and this value of e, for sufficiently large n. This is the range of applicability 
of our results with the slowest rate of convergence of A to 1. 

As mentioned earlier, and explained in more detail in Section[2l our results 
are in line with a more general hypothesis: for a very wide range of parameter 
values, the maximum queue length of the (n, d, A)-supermarket model in 
equilibrium is within 1 of the largest k such that 

n 

This general hypothesis holds when A and d are constants: see [S]. It is also 
valid for the range where A is fixed and d — )■ oo: see fl]. 

Another range not covered by Theorem 11.11 is that where d > (1 — A)~^^, 
where one should expect the maximum queue length k to be equal to 1. For 
this range, our techniques can be used, but there are several places where 
we would need to pick out /c = 1 as a special case and treat it separately. 
Rather than do this, we refer the interested reader to the PhD thesis [1] 
of Marianne Fairthorne, which contains a detailed treatment of this case. 
The authors, with Fairthorne, intend to write this result up for publication 
elsewhere. 

We also prove various rapid mixing results. For x G , let C{Xf ) denote 
the law at time t of the (n, A)-supermarket process {Xf) started in state 
X. Also let n denote the stationary distribution of the (n, d, A)-supermarket 
process. 

Theorem 1.3. Suppose that n, d, k, A and e = ^ satisfy the conditions of 
Theorem Let x be a queue-lengths vector in M^{n,d,X,k). Then, for 
t > 0, 

irvmxrm < „ (2.-i-'" + 4exp (-^^5^)) ^ 

In other words, for a copy of the process started in a state in J\f^{n, d, A, k), 
with e = ^) the mixing time is of order kd^~^nlogn < (1 — A)~^nlogn < 
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(see ()6.5p and ()6.1ip ). Formally, rapid mixing is often defined to be mixing 
in 0(n log n) steps, and this does not meet that criterion, but in fact this 
result is nearly best possible: we show that mixing, starting from states in 
AA^(n, d, A, A;), requires Q{d^~^n) steps. 

Prom states not in , we cannot expect to have rapid mixing in general. 
For instance, suppose we start from a state x with number of customers 
||x||i = gn, where g is much larger than /ca,^- The expected decrease in the 
number of customers at each step of the chain is at most so mixing 
takes — X)~^gn) steps. Similarly, if we start with one long queue, of 
length ||x||oo = ^ much greater than kx^d, then mixing takes ri(£n) steps, to 
allow time for the long queue to empty out. We prove the following result, 
giving a nearly best-possible mixing time for (Xf) in terms of ||x||i and 

Theorem 1.4. Suppose that {n,d, X,k, satisfies the hypotheses of The- 
orem [L^ and let x be any queue-lengths vector. Let 

q = (6000/cn + 4320||2;||i)(l - A)"^ + 8n||x||oo 
and suppose that q < ^es Then, for t > 2q, we have 

irviAxrm < 2MW (2e-i'°^" + 4exp {-^^^^) ■ 

The supermarket model is an instance of a model whose behaviour has 
been fully analysed even though there are an unbounded number of variables 
that need to be tracked - namely, the proportions Ui{Xt). While what we 
achieve in this paper is similar to what is achieved by Luczak and McDiarmid 
in [5] for the case where A and d are fixed as n — t- oo, only some of the 
techniques of that paper can be used here, as we now explain. 

The proofs in [5] rely on a coupling of copies of the supermarket process 
where the distance between coupled copies does not increase in time. This 
coupling is, in particular, used to establish concentration of measure, over 
a long time period, for Lipschitz functions of the queue-lengths vector; this 
result is valid for any values of (n, d. A), and in particular in our setting. 
Fast coalescence of coupled copies, and hence rapid mixing, is shown by 
comparing the behaviour of the (n, d, A)-process with the (n, 1, A)-process, 
which is easy to analyse. This then also implies concentration of measure 
for Lipschitz functions in equilibrium, and that the profile of the equilibrium 
process is well concentrated around the fixed point vr of the equations (jl.lh . 

The coupling from [5] also underlies the proofs in the present paper. How- 
ever, in our regime, comparisons with the (n, 1, A)-process are too crude. 
Thus we cannot show that the coupled copies coalesce quickly enough, until 
we know something about the profiles of the copies, in particular that their 
maximum queue lengths are small. Our approach is to investigate the equi- 
librium distribution first, as well as the time for a copy of the process from 
a fairly general starting state to reach a "good" set of states in which the 
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equilibrium copy spends most of its time. Having done this, we then prove 
rapid mixing in a very similar way to the proof in [5]. 

To show anything about the equilibrium distribution, we would like to ex- 
amine the trajectory of the vector u{Xt), whose components are the Ui{Xt) 
for i > 1. This seems difficult to do directly, but we perform a change 
of variables and analyse instead a collection of just k = k\^d functions 
Qi{Xt), . . . ,Qk{Xt). These are linear functions of ui{Xt), . . . ,Uk{Xt), with 
the property that the drift of each Qj{Xt) can be written, approximately, 
in terms of Qj{Xt) and Qj^i{Xt) only. Exceptionally, the drift of Qk{Xt) is 
written in terms of Qk{Xt) and Uk+i{Xt). The particular forms of the Qj are 
chosen by considering the Perron-Frobenius eigenvalues of certain matrices 
Mfc derived from the drifts of the Uj{x). Making this change of variables 
allows us to consider one function Qj{Xt) at a time, and show that each 
in turn drifts towards its equilibrium mean (which is derived from the fixed 
point vr of (jl.ip ). and we are thus able to prove enough about the trajectory 
of the Qj{Xt) to show that, starting from any reasonable state, with high 
probability the chain soon enters a good set of states where, in particular, 
Uk+i{Xt) = 0, and so the maximum queue length is at most k. We also show 
that, with high probability, the chain remains in this good set of states for a 
long time, which implies that the equilibrium copy spends the vast majority 
of its time in this set. The argument from [5] about coalescence of coupled 
copies can be used to show rapid mixing from this good set of states. The 
drift of the function to its equilibrium is slower than that of any other 
Qj, and its drift rate, l/(A(i)^~^n, is approximately the spectral gap of the 
Markov chain (Xt), and hence determines the speed of mixing. 

The structure of the paper is as follows. In Section [21 we expand on the 
discussion above, and motivate the definitions of the functions Qj : Z" — t- M, 
which are fundamental to the proof. In Section[3l we give a number of results 
about the long-term behaviour of random walks with drifts, including several 
variants on results from [5]. In Section [H we describe the key coupling 
from [5j, and use it to prove some results about the maximum queue length 
and number of customers. In Section [H we discuss in detail the drifts of the 
functions Qj. The proof of Theorem 11.21 starts in Section [U where we show 
how to derive a closely related result from a sequence of lemmas. These 
lemmas are proved in Sections [THSl In Section \T0\ we complete the proof of 
Theorem II. 2[ We prove our results on mixing times in Section [TTJ 



2. Heuristics 

In this section, we set out the intuition behind our results and proofs. As 
before, let (It) be an equilibrium copy of the (n, d, A)-supermarket process. 
Guided by the results in pjiSj, we start by supposing that, for each i > I, 
Ui{Yt) is well-concentrated around its expectation Ui, and seeing what that 
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implies about the Uj. We have 

^Ui{Yt) = nu^{Yt+l)-u^{Yt)\Yt] (2.1) 
^ -[\u,^i{YtY - XuiiYt)'' - Ui{Yt) + Ui+i{Yt)].{2.2) 



+ A)' 

To see this, observe that, for i > 1, conditioned on 1^, the probabihty 
that the event at time i + 1 is an arrival to a queue of length exactly i — 1, 
increasing Ui by 1/n, is (ui-i{Yt)'^ — itj(yj)'^) , while the probability that 
the event is a departure from a queue of length exactly i, decreasing Ui by 
1/n, is {ui{Yt) — Ui^i{Yt)). Note that uq is identically equal to 1. 

Taking expectations on both sides, and setting them to 0, we see that, 
since (Yt) is in equilibrium, 

= nuiiYt+i) - u,{Yt)] (2.3) 

= ■ , nXu^^i{Ytf - Xu^iYtf - Ui{Yt) + u^+i{Yt)] (2.4) 

n(l + A) 

- -TT—TTi^ut^ - ^uf - Ui + Ui+i], (2.5) 
n(l + A) 

where the approximations ¥.Ui(Yt)'^ ~ uf and En,_i(lt)'^ ~ uf_i are justi- 
fied because of our assumption that Ui {Yt) and Ui_i (It) are well-concentrated 
around their respective means Ui and Uj_i. 
The system of equations 

= Xuti - Xuf - Ui + Ui+i (i = l,2,...) (2.6) 

1 = Mo 

has a unique solution with -Uj — )• as i — )• oo, namely: 
Ui = X^^-^"'-' (z = 0,l,...). 

Sec [5] and the references therein for details. 

By analogy with [5j, and motivated by (j2.3p . if the Ui{Yt) are well con- 
centrated, we expect that Ui w Uj, for each i, and moreover that the values 
of Ui{Yt) remain close to the corresponding Ui for long periods of time. In 
the regime of Theorem 11.21 

\ogUi = log(l-(l-A))(l + --- + (i^-i) 

= -(l-A)(i*-i(l + 0(l-A))(l + 0(l/d)) 
= -{l-X)d'-\l + 0{l/log^n)), 

for each i > 1. In particular, Uk+i is much smaller than 1/n - recall that 
^'^(l — A) > 2 log^ n. One part of our goal is to show that indeed, in equilib- 
rium, for a long period of time there is no queue of length greater than k. 

On the other hand, for i < k, our assumptions on A and d imply that 
Ui is close to 1 - recall that (i'^~^(l — A) < e/WOk. This suggests that, in 
equilibrium, most queues have length exactly k. Moreover, uf = 1 — o(l) 
for i < k, so that 1 — uf ^ d{l — Ui), whereas uf. = o(l). We then obtain 
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the following linear approximation to the equations (12. 6|) . written in terms 
of variables 1 — ui, . . . , 1 — Uk- 

= A(i(l-ni) + (l-ni)-(l-n2), 

= -Xd{l-u,_i) + Xd{l-Ui) + {l-Ui)-{l-Ui+i) 

(2 < i < /c - 1), 

= -Xd{l-Uk-i) + {l-Uk)-{l-X). 
These linear equations have solution u given by 

1 - = (1 - A)(l + (Ad) + • • • + {Xdy-^), 

for i = 1, . . . ,k. We then have the further approximation 

1 - ^ {1 - x){Xdy-\ 

for i = 1, . . . , A;. 

Ideally, we would seek a single function of the Ui{x), which is small when 
Ui{x) ~ Ui for each i, and larger otherwise, and which has a downward drift 
outside of a small neighbourhood of u: we could then analyse the trajectory 
of this function to show that {ui{x), . . . ,Uk{x)) stays close to u for a long 
period. We have been unable to find such a function, and indeed analysing 
the evolution of the Ui{Xt) directly appears to be challenging. Instead, we 
work with a sequence of functions Qj{x), j = 1,. . . ,k, each of the form 
Qj{x) = 'T' 7j,j(l — Ui{x)), where the jj^i are positive real coefficients. 
This sequence of functions has the property that the drift of each Qj (x) can 
be written (approximately) in terms of Qj{x) itself and Qj+i{x). 

Let us see how these coefficients should be chosen, starting with the special 
case j = k, where we write /3j for 7fc^j. Consider a function of the form 
Qk{x) = "-X^iLi ft(l — Uiix)). As in the argument leading to (12. ID . we have 
that the drift of this function satisfies 

(l + A)AQfc(x) 

k 

= -{1 + X)nY^PiAui{x) 

1=1 

k 

= A[An»-i(x)'^ - Xui{xy - Ui{x) + Ui+i{x)] 

k 

= 5^ft[A(l - ui.iix)'') - A(l - u^ix^) - (1 - u,{x)) + (1 - Ui+i{x))]. 
1=1 

Making the approximations Uk+i{x) ~ 0, Uk{x)'^ ~ 0, and 1 — Ui{x)'^ ~ 
d[l — Ui[x)) for i = l,...,A; — 1, and rearranging, we arrive at 

(l + A)AQfc(x) ~ I3k{l - X) + {h-i - Mil - uk{x)) 

k-l 

+ ^[Ad(ft+i - Pi) -pi + ft_i](l - Ui{x)). 

i=l 
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We set /3o = for convenience of writing the above expression. This calcu- 
lation is done carefully, with precise inequalities, in Lemma l5.ll below. We 
would like to choose the /3j so that the vector 

(Ad(/32 - /3i) - /3i + /3o, . . . , Ad(/3fc - (ik-i) - h-i + A-2, A-i - h) 

is a (negative) multiple of (/3i, . . . ,f3k~i,f3k)- This would entail 

(1 + X)AQk{x) ~ /3fc(l - A) - fiQkix), 

for some (positive) fj,, which in turn would mean that Qk drifts towards a 
value of /3fc(l — A)//U, which should be very close to n(l — A)(A(i)^~^ - if Qk is 
above this value then it drifts down, whereas if is below then it drifts up. 
The point is that these drifts can be bounded below in magnitude, regardless 
of the precise values of the Ui that go towards making up Qk- What we need 
for . . . , Pk-i, Pk) to be a left eigenvector of the k x k matrix 



IS 



/-Ad - 1 
Ad 




Mk 



\ 










1 

-Ad - 1 
Ad 









1 

-Ad - 1 












-Ad- 
Ad 








1 

-Ad- 
Ad 



0\ 








1 1 



V 



or, equivalently, of the matrix 



/ 10 
Ad 1 
Ad 



M'k = Mk + (Ad + 1)4 














\ 





1 

Ad 1 

\d \dj 



The non-negative matrix has a unique largest eigenvalue, with a positive 
left eigenvector. By inspection, we see that this eigenvector is close to the 
all-1 vector, with an eigenvalue close to Ad + 1, so that Mk has largest 
eigenvalue very close to 0. Recursion shows that a better approximation to 
the Perron-Frobenius eigenvector of is (/3i, . . . , f3k-i, f3k) , where 



1 



1 - 1) 

(Ad)^ (Ad)'^ ' 



for i = 1, . . . ,k, and the largest eigenvalue of Mk is very close to — l/(Ad)'^~"^. 
We shall see in Lemma |5. II that this approximation is close enough for our 
purposes. 
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For 1 < J < fc, a similar analysis reveals that, if Qj{x) = X]i=i 7j,«(l 



Ui), then 



{l+X)AQj{x) ~ [7j,i_i + Xd-fj,i+i - (Ad+ l)7j-i]+(l-nj+i(x)). 



1=1 



(See the proof of Lemma [5. 2[ ) We think of 1 — Uj+i (x) as an "external" term 
(which in practice will be very close to Qj^i{x)/n), which will determine 
the value towards which Qj drifts. We would like the rest of the expression 
to be a negative multiple of Qj{x). For this we need (7j,i, • • • ,7jj) to be a 
left eigenvector of the j x j matrix 

\ 





/-Xd-l 1 
























Xd -Xd-l 


1 





















Xd - 


Xd- 


- 1 

















































-Ad 


- 1 


1 



















Ad 




-Ad- 


- 1 


1 



















Ad 




-Ad 


or, equivalently, of the matrix 






















/o 


Xd 


• 


• 





0\ 








1 





Ad • 


• 

















1 


• 


• 










Mj = Mj + {Xd + 




























• 


• 


Ad 

















• 


• 1 





Ad 








^0 





• 


• 


1 


0^ 





These matrices are tridiagonal Toeplitz matrices, and there is an exact for- 
mula for the eigenvalues and eigenvectors. (See, for instance. Example 7.2.5 

in [To].) The Perron-Frobenius eigenvalue of Mj is 2\/Adcos (^j^^, with 

the left eigenvector (7j,i, . . . , 7jj) given by 



7j,i = (Ad) 



sm , . , , 

(j-i)/2_ 



sm 



JJL_ 

i+1 



This means that the largest eigenvalue of Mj is —Ad + 0(v Ad), so that we 
obtain 



(1 + A)AQj(x) 



n 



n 



{l<j<k), 
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meaning that Qj{x) will drift to a value close to Qj+i{x)/Xd. The choices 
of coefficients ensure that, if the Uj{x) are all near to uj, then 



and the top term i = j dominates the rest of the sum, provided Xd is large, 
so Qj{x) ~ (1 — Uj{x)): this is also true for j = k. Thus the relationship 
Qj ~ Qj^i/Xd is as we would expect. 

This means that, if Qj-^-i{Xt) remains in an interval around Qj+i := 
n(l — X){Xdy for a long time, then Qj{Xt) will enter some interval around 
Qj within a short time, and stay there for a long time. We can then conduct 
the analysis for each Qj in turn, starting with j = k, to show that indeed 
all the Qj{Xt) quickly become close to Qj, and stay close for a long time. 
This will then imply that the Uj{Xt) all become and remain close to Uj. 

A subsidiary application of this same technique forms another important 
step in the proofs (see the proof of Lemma [6.5( l)). If we do not assume that 
Uk+i{x) is zero, but instead build this term into our calculations, we obtain 
the approximation 



If Uk+i{Xt) remains above e(l — A), for some e > 0, for a long time, this drift 
equation tells us that drifts down into an interval whose upper end is 
below the value Qk, and then each of the Qj in turn drift down into intervals 
whose upper ends are below the corresponding Qj, and remain there. For 
j = 1, this means that the number of empty queues is at most {1 — 5){1 — X)n, 
for some positive 6, for a long period of time; this results in a persistent drift 
down in the total number of customers (since the departure rate is bounded 
below by n — (1 — 6){1 — X)n = Xn + 6{1 — X)n while the arrival rate is An), 
and this is not possible. 



In this section, we prove some general results about the long-term be- 
haviour of real- valued functions of a Markov chain with bounds on the drift. 

We start with two lemmas concerning random walks with a drift, both 
adapted from lemmas introduced in Luczak and McDiarmid [5J. In each case, 
we assume that we have a sequence {Rt) of real- valued random variables on 
some probability space. On some "good" event, the jumps Zt = Rt — Rt-i 
have magnitude at most 1, and expectation at most —v < 0. The first 
lemma shows that, on the good event, with high probability, such a random 
walk, started at some value tq, hits a lower value ri after not too many more 
than (ro — ri)/v steps. 




(1 + X)AQk{x) ~ (1 - A - Uk+i{x)) 



Qk{x) 



{Xdf'^n 



3. Random Walks with Drifts 
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Lemma 3.1. Let ^po Q fi ■ ■ ■ be a filtration, and let Zi, . . . , Zm he 

random variables taking values in [—1, 1] such that each Zi is (fi-measurable. 

Let Eq, El, . . . , E„i^i be events where E-i G (pi for each i, and let E = 
nrio^ ^i- ^ ^ (0' '^^'^ ^o^^i & ^ be such that ro > ri and vm > 
2(ro — ri). Set Ro = ro and, for each integer t > 0, let Rt = Rq + X^i=i Z^. 
Suppose that, for each i = 1, . . . ,m, 

E{Zi I (pi^i) < -V on Ei^i n {Ri-i > n}. 

Then 

2 

nEn{Rt > ri yte {1,. . . ,m}}) < exp ( - 

Proof. We first prove the lemma assuming the inequalities E(Zj | ipi-i) < —v 
hold almost surely, that is ignoring the events fl {Ri-i > ri}. We shall 
then see how to incorporate these events. 

We can couple the Z^ with random variables Vi taking values in [—1,1] 
such that E[Vi \ ifi-i] = —v for each i and ¥{Zi < VJ) = 1 for each i: to do 
this, we define Vi as follows. Take a U[0, 1] random variable Wi, independent 
of the Zi and the other Wj, and set pi = (v + 1)/(1 - E[Zi \ ifi-i]) G [0, 1]. 
Now set Vi = Ziln4/.<p.j. + l^y.^p.}. Note that indeed \Vi\ < 1 for each i 
and F{Vi > Zi) = 1. Furthermore, ' 

E[Vi I =PiE[Zi I ifi^i] + (I-Pi) = -pi{l-E[Zi I ipi_i]) + l = -v. 

For each t > 0, let St = E*=i ^i, so St > E*=i Zi = Rt - Ro, set nt = 
—vt = ESt, and note that (St — fJ-t) is a martingale. By the Hoeffding-Azuma 
inequality, F{St > lJ^t + y) < cxp(— y^/2i). Thus, if a = ro — ri < ^vm, 

P(i?t>ri Vi G {l,...,m} I i?o = r-o) < P(i?„ - i?o > -a) 

< ¥{Sra>-a) 

( {vm — aS^\ 

Now let us return to the full lemma as stated, with the events Ei. For 
each z = 0, 1, . . . , m — 1, let = £'j n {Ri > ri}, and for each i = 1, . . . ,m, 
let Zi = Zjlp. , — Let Rn = Ro and, for i = l,...,m, let FL = 

Ro + Y.\=iZi- Then E{Zi I ipi-i) < —V. Hence, by what we have just 
proved applied to the Zi, 

F{En{Rt>ri Vt G {l,...,m}} I i?o = ro) 
= ¥{En{Rt>ri yt€{l,...,m}}\Ro = ro) 
< ¥{Rt>ri Vt G {l,...,m}) 
/ v^m\ 

as required. □ 
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The next lemma states that, if a discrete-time 1-dimensional random walk 
{Hf), starting at ho and making jumps of size at most 1, has negative drift 

whenever it lies in the interval [ho — b,hQ + a), then it is unlikely to "cross 
against the drift" and make its first exit from the interval at the upper end. 

Lemma 3.2. Let ho, a and b be positive real numbers. Let v G (0,1]. Let 
V'o ^ (^1 C . . . be a filtration, and let Zi, Z2, ■ ■ ■ be random variables taking 
values in [—1, 1] such that each Zi is ipi-measurable. Let Eq, Ei, . . . be events 
where Ei G ipi for each i. Let Hq be ipQ-measurable, and, for each integer 
i > 0, let Ht = Hq + Yll^i Zi. Assume for each i = 1, . . ., 

E{Zi I ifi-i) < —V on Ei-i n {ho — b< ifj-i < ho + a}. 

Let 

T-l 

T = inf{t >l:Hte (-00, ho-b)U [ho + a, 00)}, and E = Q Ei. 

1=0 

Then, on the event that Hq = ho, 

F{E n {Ht >ho + a}\ ipo) < e^^^". 

Proof. Let us first ignore the events E^. 

Note that, for any function / convex on [—1, 1], we have 



z G 



-1,1], 



so, for each i, 

nf{Zi) I 



-1 :^ 



< E 



^ /(l)-/(-l) , /(l) + /(-l) , 

Zi : 1 I ipi-i 



Let Mt = for each t G Z+, and note that f{z) = (1^)' 

convex on [—1,1]. Then, for each i G N, 

K[Mt\ ^t-i] 

\l-v) 



= Mt-iE 
< Mt-i 



l + v 



'Pt-i 
1-v 



.2(1-1;) 2{l + v 

^ ^^A-iw^) 2(1+.) 

v'^ 1 — \ 



1 — V \ 

'.(l + v)) 



2(1 



l + v 1 
- + 



2(1 + v) 



+ 



l + v 



+ 



2(1 -v) 2{l + v) 



1 — V \ 



t-i 



1 



IS 



.2(1 -v) 2(1 + .), 

= Mt_i, 

so (Mt) is a supermartingale. We deduce that, on the event that Ho = ho, 

(1 + 1; \ feo 



THE SUPERMARKET MODEL WITH ARRIVAL RATE TENDING TO ONE 17 



Thus, by the optional stopping theorem, on the event that Hq = ho, 
/I + v\'^o 

(j^J > E[Mt I ifo] 

> FiHT>ho + a\ipo)[Y^) MHT<ho~b}\vo 

Using the elementary inequality {1 + v)/{l — v) > e^"" for < u < 1, we 
deduce that, on the event that Hq = ho, 

HHt >ho + a\^o)< < e-'"^ 



.1 - V. 

which yields the result in the case without the events Ei. 

Now let us incorporate the events Ei, and consider the full lemma as 
stated. For each i = 0,1, let Fi = EiCi {ho — b < Hi < ho + a} e ipi and 
Zi = — I jT^. ^ . Let Ht and T be defined in the obvious way. Then 

Zi is 99j-measurablc, Zi G [—1, 1] and E[Zj | t/Jj-i] < —v. 

On the event (^JSq Fi = [^JSq Ei = E, we have Ht = Hf, and so, 
applying the first part of the proof to the Zi, 

F{E n {Ht >ho + a}\ (po) < ^{Hf >ho + a\ifo)< e"^''", 
on the event that Ho = ho, as required. □ 

We now use the two lemmas above to prove a result about real-valued 
functions of a Markov chain, that we shall use repeatedly in our proofs. 

For a real-valued function F defined on the set Z" of queue-lengths vec- 
tors, a copy {Xt) of the (n, d, A)-supermarkct process, and x G Z" , we define 

AF(x) := nF{Xt+i) - F{Xt) \ Xt = x], 

and call this the drift of F (at x). Similarly, we shall also use the notation 
AF(Xt) to denote the random variable ¥\F{Xt+i) - F{Xt) \ Xt]. 

Lemma 3.3. Let h, v, c, p > 2, m and s be positive real numbers with 

vm > 2(c — h). Let {Xt)t>o be a discrete-time Markov process with state- 
space X , adapted to the filtration {(pt)t>o- Let S be a subset of X, and let F 
be a real-valued function on X such that, for all x G S with F{x) > h, 

AF{x) < -V, 

and for all t>0, \F{Xt^i) — F{Xt)\ < 1 a.s. Let T* be any stopping time, 
and suppose that F{Xt*) < c a.s. 
Let 

To = M{t >T* -.Xti S], 
Ti = inf{t > T* : F{Xt) < h}, 
T2 = mi{t > Ti : F{Xt) >h + p}. 

Then 

(i) P(Ti hTo>T* +m) < e:^-p{-v'^m/S); 

(ii) P(r2 < s A To) < sexp(-p'i;). 
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When we use the lemma, m will be much smaller than s, and moreover 
with high probability T* will be much smaller than s, and also P(To < s) 
will be small. In these circumstances, the lemma allows us to conclude that, 
with high probability, F{Xt) decreases from its value at T* (at most c) to 
below h in at most a further m steps, and does not increase back above h + p 
before time s. We shall sometimes use the conclusion of (ii) in the weaker 
form P(r2 < s < To) < sex.p{—pv). 

Proof. We start by proving the lemma in the special case where the stopping 
time T* is equal to 0. 

For (i) , we apply Lemma 13.11 The filtration ^ Vi ^ ■ " ■ ^ will 
be the initial segment of the filtration {ipt)t>o- For t > 1, we set Zt = 
F{Xt) - F{Xt-i), so that Rt := Rq + T!^=lZ^ = F{Xt). For t > 0, we 
set Ft to be the event that Tq > t (i.e., G 5 for all i with < « < t), 
so F = ni^Lo event that Tq > in. We set tq = F{Xq) < c, and 

ri = h. We may assume that tq > ri; otherwise Ti = and there is nothing 
to prove. 

On the event E'j-i n {Ri-i > ri}, we have G S and F(Xj_i) > n = 
h, so E(Zj I ifi-i) = AF(Xj_i) < —V. Thus, noting that vm > 2(ro — ri) by 
our assumption on m, we see that the conditions of Lemma [3. II are satisfied. 
The event that Rt > ri for all t = 1, . . . , m is the event that Ti > m, so 

P(ri A To > m) < P({ri > m} n {To > m}) < e-'^''"/^ 

as required for (i). 

We move on to (ii). For each time r G {0, . . . , s — 1}, set 

T(r) = min{t > : F{Xr+t) ^[h,h + p)}. 

We say that r is a departure point if: Ti < r, F{Xr) G [h, h+1), F{Xr-i^T{r)) ^ 
h + p, and r + T(r) < s A Tq. To say that T2 < s ATq means that F{Xt) 
crosses from its value, at most h, at time Ti, up to a value at least h + p, 
taking steps of size at most 1, by time s A Tq. This is equivalent to saying 
that there is at least one departure point r G [0,s). Therefore 

P(r2 < s A To) 

s-1 

< ^P({ri <r}n{F(X^) G [/i,/i + l)} 

r=0 

r\{F{X,^T{r)) >h + p}f^{r + T{r) < s A Tq}) 

s-l 

= [^{^1<^}^{''^('^'-)6^,'J+1)}^ [^{mr+T{r))>/i+P}l{'-+TW<sAro} I V^r] • 

Fix any r G [0,s). We claim that, for any /iq G + 1), on the ipr- 
measurable event that F{Xj.) = /ig, the conditional expectation 

IE [^{F{X,+T(r))>h+p}^{r+T{r)<sATo} I V'r] 
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is at most . This will imply that each term of the sum above is at most 
e~^^ , and so that P(r2 < s A To) < sex.p{—pv), as required. 

To prove the claim, we use Lemma [3. 2 [ We consider the re-indexed process 
(Xf) = (Xr+t)', by the Markov property, this is a Markov chain with the same 
transition probabilities as (Xt), and initial state X'q = X^ with F{Xq) = ho. 
We set ip[ = (fr+i for each i, so that is adapted to the filtration {^'i). 
Let Zi = F[X'j) — F[X[_i)^ so that |Zj| < 1, and Zi is y^^-measurable, for 
each i. Set Hq = = F(X^), so that Ht = Hq + J^Li^i = F{X't). 
We set a = h + p — Hq > p — 1 > p/2, and b = Hq — h. Thus the event 
{ho — b < Hi^i < ho + a} translates to {h < F{X-_-^^) < h + p}, and the 
event {Hx(r) ^ ho + a} translates to F{Xr_^_x(r)) > h + p. 

For i = 0, . . . , s, set Ei = {r + i < s A Tq}, noting that this event is 

in if'-, and that E := flSJ'^-^i = {r + T{r) < s A To}. On the event 
Ei^in{ho-b < Hi^i < ho+a}, we have F{Xl_-^^) > h, and X'^^^ = Xr+i-i G 
S, and therefore E(Zj | v^i-i) = ^-^i-^'i-i) — From Lemma [3.21 we now 
conclude that, on the event F{Xr) = ho, 



as required. This completes the proof in the special case where T* = 0. 

We now proceed to the general case. Suppose then that the hypotheses of 
the lemma are satisfied, with stopping time T* . We apply the result we have 
just proved to the process (Xf) = {XT*+t)- By the strong Markov property, 
(Xj.) is also a Markov process, adapted to the filtration {(pt)t>o = {VT*+t)t>o- 
The condition that F{Xt*) < c is equivalent to F{X'q) < c. Set: 



To = mi{t >0:Xl^S} = mi{t > : Xr^+t ^ S} = Tq - T* 

T[ = mi{t > : F{X't) < h} = mf{t > : F^XT^+t) < h} = Ti - T* 

T^ = mf{t > T[ : F{X't) >h + p} = inf{t > T[ : F{XT*+t) > h + p} = T2 



and note that these are all stopping times with respect to the filtration {ft). 
The special case of the result (with T* = 0) now tells us that: 



(i) P(ri A To > T* + m) = F{{T* + T[) A {T* + To) > T* + m) 



P ({F(X,+r(r)) >h + p}n{r + T{r) < s <To}\ 



) 




< e 



— 2va 



< 



p(r{ A > m) 

exp(— v^m/S); 



(ii) P(r2 < s A To) 



< 



p(r* + < sA{T* + To)) 

p(r* + < (T* + s) A (r* + To)) 



< 



P(T^ < s A T(^) 
exp(— /3f ). 
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In both cases, these are the desired results. □ 



We shah also make use of a "reversed" version of Lemma 13.31 where 
AF{x) > V for all x in some "good" set S with F(x) < h. The result 
and proof are practically identical to Lemma 13.31 changing the directions of 
inequalities where necessary, and using "reversed" versions of Lemmas 13.11 
and [321 

The next lemma is a more precise version of Lemma 2.2 in [5\. We omit 
the proof, which is exactly as in [5], except that we track more carefully the 
values of the various constants appearing in that proof, and separate out 
the effects of the two occurrences of 6 in that theorem. 

Lemma 3.4. Let {ipt)t>o be a filtration. Let Zi,Z2,... be {0,zizl} -valued 
random variables, where each Zi is ipi -measurable. Let Sq > a.s., and 
for each positive integer j let Sj = Sq + Zi. Let Aq,Ai,... be events, 
where each Ai is ipi-measurahle. 

Suppose that there is a positive integer ko and a constant 5 with < 5 < 
1/2 such that 

P(Z, = -1 I ipi.i) > 6 on Ai_i n G {1, . . . , A;o - 1}} 

and 

F{Zi = -1 I ifi^i) > 3/4 on Ai^i n > A;o}. 

Then, for each positive integer m 



f|{5i / 0} n fl < P(5o > LW16J) + 3exp 



i=0 



200A;n 



-m 



Several times we shall use the fact that, if Z is a binomial or Poisson 
random variable with mean /i, then for each < e < 1 we have 

P(Z - < -e/i) < e-(i/2)^'''. (3.1) 



4. Coupling 

We now introduce a natural coupling of copies of the (n, d, A)-supermarket 
process {Xf) with different initial states x. The coupling is a natural adap- 
tation to discrete time of that in [5 1 . 

We describe the coupling in terms of three sequences of random variables. 
There is an iid sequence V = (Vi, V2, . . .) of 0-1 random variables where each 
Vi takes value 1 with probability A/(l + A); Vi = 1 if and only if time i is 
an arrival. Corresponding to every time i there is also an ordered list Di 
of d queue indices, each chosen uniformly at random with replacement. Let 
D = (Di, 1)2, . . .)• Furthermore, corresponding to every time i there is a 
uniformly chosen queue index D^. Let D = (Di, D2, . . .)■ At time i, Di will 
be used if = 1, and there will be an arrival to the first shortest queue in 
Di] otherwise, there will be a departure from the queue with index Dj, if 
that queue is currently non-empty. 
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Suppose that we are given a realisation (v,d,d) of (V, D,D). For each 
possible initial queue- lengths vector x G Z" , this realisation yields a deter- 
ministic process (xt) with xq = x: let us write xt = sj(x; v,d,d). Then, for 
each X € , the process st{x; V, D, D) has the distribution of the (n, d, A)- 
supermarket process Xf with initial state x. In this way, we construct copies 
{Xf) of the (n, d, A)-supermarket process for each possible starting state x 
on a single probability space. When we treat more than one such copy at 
the same time, we always work in this probability space, and we let P(-) 
denote the corresponding coupling measure. 

We shall use the following lemma, which is a discrete-time analogue of 
Lemma 2.3 in |5] and is proved in exactly the same way. 

Lemma 4.1. Fix any triple z,d,d as above, and for each queue-lengths 
vector X write St{x) for St{x; z, d, d). Then, for each x,y €z , both \\st{x) — 
St{y)\\i and \\st{x) — st{y)\\oo ctre nonincreasing; and further, if < t < t' 
and st{x) < st{y), then st'{x) < Sf/iy). 

For a queue-lengths vector x, let ||x||oo = maxx(i) denote the maximum 
length of a queue in x, and ||x||i = X^"=ix(i) denote the total number of 
customers. Given positive real numbers i and g, we set 

•^o(-^iS') = {x '■ \\x\\oo < i and ||x||i < gn}; 
•^il-^;^) = {x '■ \\x\\oo < 3£ and ||x||i < 3gn}. 

We also set 

r = log2n(l - X)-\ g* = 2(1 - X)-\ = Ao{t,g*), A*, = Ai{t,g*). 

The next result tells us that the (n, d, A)-supermarket process (It) in 
equilibrium is very unlikely to be outside the set ^q, for any d. This is 
accomplished by proving the result for d = 1, when the process is easy to 
analyse explicitly, and then using coupling in d to deduce the result for all d. 
Of course, the result is actually extremely weak for all d > 1, and later we 
shall show a much stronger result whenever the various parameters of the 
model satisfy the conditions of Theorem II. 2j the importance of the lemma 
below is that it gets us started and enables us to say something about where 
the equilibrium of the process lives. 

Lemma 4.2. Let (Yj) be a copy of the {n, d, \)- supermarket process in equi- 
librium. Then F(Yt ^ A*q) < 2ne-'°s'". 

Proof. Let Y denote a stationary copy of the (n, 1, A)-supermarket pro- 
cess, in which each arriving customer joins a uniform random queue. Then 
the queue lengths Yt{j) are independent geometric random variables with 
mean A/(l - A), where ¥{Yt{j) = k) = {1 - X)X'' for k = 0,1,2,.... 
Therefore, Pdl^tHoo > k) < , and also it can easily be checked that 
F (llltlli > 2n(l - A)-i) < e-"/l 
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As mentioned in Section [H there is a coupling between supermarket pro- 
cesses with different values of d, which can be used to show that the equi- 
librium copy (Yt) of the (n, d, A)-supermarket process, for any d, also sat- 
isfies F{\\Yt\\i > 2n(l - A)-i) < e""/^ and P(||yf||oo > log^ n{l - A)"^) < 
nA^°e' n(i-A)-i < ^g- iog2 required. □ 

Next we prove a very crude concentration of measure result: if the process 
(Yt) in equilibrium is concentrated inside some set Ao{i,g), and we start a 
copy (Xf) of the process at a state x £ Ao{i,g), then the process (ACf) is 
unlikely to leave the larger set Ai{l,g) over a long period of time. 

Lemma 4.3. Let i and g be natural numbers and x a queue-lengths vector 
in ^o(^) §)■ Then for any natural number s, 

P(3t e [0,s], Xf i Ax{i.g)) < P(3t e [0,s], Yt i A^[i,g)). 

Proof. By Lemma 14. H we can couple (^f ) and (1^) in such a way that 
\\Xt — YjIIi and — lt||oo are both non- increasing, and hence that, for 
each t > 0, 

ll^rili < ||xf -y^iii + iiytiii 

< ||x-yol|i + ll^t||i 

< ||x||i + ||yol|i + ll^tlli 

< gn + \\Yo\\i + \\Yt\\i, 

and similarly 

ll-'^^f lloo < + ll^olloo + ll^illoo- 

We deduce that, for each t > 0, 

{Xf^A,{e,g)} = {||Xf||i>35n}U{||Xf|U>£} 
C {\\Yo\\i > gn} U {\\Yt\\i > gn} 

u{||yol|oo >nu{||y||oo >n 

= {Yo(^Ao{e,g)}U{Yt^Ao{e,g)}. 
The result now follows immediately. □ 

We shall use Lemma 14.31 later for general values of i and g, but for now 
we note the following immediate consequence of the previous two lemmas. 

Lemma 4.4. Let x be any queue-lengths vector in Aq, and let = inf{t : 
Xf ^ Al}. Then, for n > 2000, 

Proof The probability in question is F{3t € [0,6^^°^''"]^ xf ^ Al) which, 
by Lemma 14.31 and Lemma 14.21 is at most 

F{3t E [0,e^i°§'"], Yt i A*^ < (e^i"^'" + l)F{Yt i Al) < 3ne-i'°g'", 

which, for n > 2000, is at most e~2^°^ as required. □ 
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5. Functions and Drifts 

We now start the detailed proofs. The results in this section will be used 
in the course of the proof of Theorem 11.21 and we could assume that all the 
conditions of Theorem 11.21 hold : however, for this section all that is necessary 
is that k>2 and Xd > 4. 

As explained in Section [21 we will consider a sequence of functions Qk, 
Qk-i, ■ ■ ■ , Qi defined on the set Z" of queue-lengths vectors. We now give 
precise definitions of these functions, along with another function Pk-i, and 
derive some of their properties. 

As in Section [21 let Qk be the function defined on the set of all queue- 
lengths vectors by 

k 

Qk{x) = n^/3i(l - Ui{x)), 

i=l 

where, for i = 1, . . . , A;, 

{MY {Xdf ■ 

It is also convenient to set /3o = 0. Evidently /3i < 1 for each an inequality 
we shall use freely in future. We also note that /3j is increasing in i, and 
that /3fc = 1 - k{\d)-^. 
Let 

k-l 

Pk-i{x) = - Ui{x)). 

i=l 

Also, for J = 1, . . . , /c — 1, we let 

3 

Qj{x) = n^7j-i(l - Ui{x)), 

i=l 

where the coefficients 7j^j are given by 



sm 



sm , . , , 

7,, = (Aci)(^--)/2— ^ 

i+i 



Consistent with the expression above, we also define 7j^o = — 0- I* can 

easily be checked that, for each i = l,...,j — 1, and for each j = l,...,A; — 1, 

A(i7j,i+i 7j,i_i = 2\/Adcos (-^y)^-?'*' 

This is equivalent to saying that the 7j^j form eigenvectors of the tridiagonal 
Toeplitz matrices Mj given in Section [21 

We will need some bounds on the sizes of the Qj{x). Observe that ^jj = 1 
for each j, while generally we have 

sin(f7r/(j + 1)) sin(i7r/(j + I)) 
- sm{jTT/{j + 1)) sin(7r/(j -I- 1)) 
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since the sine function is concave on [0, vr]. Thus 

(Ad)(j-^)/2 < < i(Ad)(^-^)/2, (5.1) 

and therefore 

3 

Qj{x) < n^i(Ad)(J-')/2 < 2n(Ad)(^-i)/2^ (5.2) 

i=l 

provided Ac? > 4. We also note at this point that changing one component 
x{£) of X by ±1 changes Qj{x) by at most jj^i = {Xd)^^^^^^'^ . 
It can readily be checked that, for j > 1, the function 



f(i) = sin ( I / sin ( ) 



is increasing over the range [1, j], and so we have, for 1 < z < j < A; — 2: 
^^■+1.' _ ,/)^sin(i7r/(i + 2)) sin(7r/(i + 1)) 



7j,i sin(i7r/ (j + 1)) sin(7r/ {j + 2)) 

< ^/^ sin(i7r/(j + 2)) sin(7r/(i + 1)) 
sin(i7r/(j + 1)) sin(7r/(j + 2)) 
sin(27r/(i + 2)) 



sin(7r/(i + 2)) 



A consequence is that, for j = 1, . . . , — 2, and any x G Z^, 

= (l-^,+i(x)) + ^7,Wl-«.(^)) 
1=1 

3 

< (1 - uj+i{x)) + 2\/Ad7j- j(l - Ui{x)) 

i=l 

< {l-Ui+i{x)) + 2VM^^. (5.3) 

n 

For j = k — 1, we have the stronger inequality that, for any x G Z^, 

^ < ^(1 - u,{x)) < (1 - n,(x)) + (5.4) 
1=1 

We now prove the following result about the drift of the function Qh{x): 
roughly speaking, we wish to show that it is approximately equal to 

3^(^1-A-W-)-^^^ 
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Lemma 5.1. For any state x € , 

(l + A)AQfc(x) < l3k{{l-\)-Uk+i{x) + \eM-dQk{x)/kn)) 

1 Qk{x) _ 2\ 



1 Qfc(x) 



(l + A)AQfc(x) > /3fe((l-A)-t.fc+i(x-)) 



Qk-\{x)\^ 1 



n ) {Mf-^' 
Proof. As in (j2.ip . we have that, for i = 1, . . . ,k, 

Aui{x) = (A'Uj_i(2;)"' - Xui{x)''- - Ui{x) + Ui+i{x)) 

n[l + Aj V / 

and that uq is identically equal to 1. We deduce that 

k 

^Qk{x) = -n'^ (3iAui{x) 
1=1 

k 



A f - Xui-.i{xY + Xui{xY + Ui{x) - Ui+i{x) 



We rearrange the formula above as follows: 
(l + A)AQfc(x) 

= Pk ((1 - A) + Xukix)'^ - Uk+iix) + A(l - Uk-iixf) - (1 - nfc(x))) 



+ ^/3i(A(l - Ui^iix)"^) - A(l - - (1 - Ui{x)) + (1 - ni+i(x))) 

13k ((1 - A) + A'Ufc(x)'^ - Uk+iix)) 

k-l k 



i=l i=l 

Here we have used the facts that /3o = and 1 — no(a;) = 0. 

Now, for 1 < i < /c, we have 1 — Uk{x) > 1 — Ui{x) and (3k ^ f3i, and so 
— Uk{x)) > Qk{x)/kn, and hence 

< Uk{xf < (^1 - < exp{-dQk{x)/kn). 

In order to estimate the terms constituting the two sums, we note the 
inequalities 

d{l - u) - Z"^) (1 - ^^)^ < 1 - ^^'^ < d{l - u). 
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To obtain our upper bound on AQk{x), we apply the inequality 1 — Uj(x)°' < 
d{l — Ui{x)) for each i = 1, . . . ,k — 1. Since also 

for i = 0, . . . , /c — 1, we have 

k-l k 



1=1 



i=l 



k-l 



1=1 1=1 
1 2 



i=l 



1 



(Ad)'^ 
Ad Ad 



(1 - Uk{x)) 

Xd 



1 1 1 

+ + 



{XdY (Ad)'+i (Xd)'' {Xdy-^ (Ad)* (Ad)^ 



;i - Ui{x)) 



< 



(Ad)'=-i 

1 Qkjx) 
(Ad) 



l-|^)(l-n.(.)) + g(l-3L)(l-n. 

i=l 



k-l 



n 



This establishes the required upper bound on (1 + X)/S.Qk{x). The calcu- 
lation works because the j3i are the entries of a good approximation to the 
dominant eigenvector of the matrix defined in Section [2l 

For the lower bound, the previous calculation, and the bound 1 — Ui{x)'^ > 
d(l - n) - (2) (1 - u)2, lead us to 

k-l k 

A J^(A+i - ft)(l - Uiix^) - Y,{^i - - Ui{x)) 



i=l 



> -X 



i=l 



k-l 



^(/3,+i-A)(l-n,(x))^ 



1=1 



1 



(Ad)'=-i 
fc-i 



(i-A)(i-u,w)+x:(i-i;)(i-u.w) 

1=1 



> -X 



^(ft+i -/?,)(! -n,(x))^ 



1 Qk{x) 



i=l 



(Ad) 



fc-i 



n 



Here we used the fact that 1 — l/(Ad) < j3i for each i. 
It remains to show that 



A 



k-l 



^(ft+l-ft)(l-«,(x))2< 



i=l 



Qk-l{x) 



n 



1 



(Ad) 



A:-3 ■ 
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We observe that 



1=1 

fe-i 



i=l 



which impUes the required inequahty. □ 

We prove a similar result for the functions Qjix), 1 < j < k — 1. Ideally, 
the drift bounds would be expressed in terms of Qj{x) itself and Qj+i{x): 
however, there is a complication. In the upper bound, there appears a term 
which can be bounded above by A(2) Si=i7j,i(l ~ , and we would 

like to show that this is small compared with Ad^j^^^ 7j,i(l ~ This 
is true if 1 — Uj{x) <^l/d, but in general we cannot assume this. We bound 
this term above, very crudely, by 

(g(l-..W)) (E7..(1-»<W)) =aQ ^^-WQ'W ; 

we use the function Pk-i here because its drifts are relatively easy to handle. 
Lemma 5.2. Fix j with 1 < j < k — 1. For any state x G Z" , we have 

(l + A)AQ,(x) < -Xd^ A _ 2 _ Q,^,ix) 
^ n V VXd n J n ' 

(1 + A)AQ,(.) > -Ad^(l + -i=) + ^^+^^^) 



n 



Proof. We begin by calculating 

i 



{l + X)AQj{x) = '^'yj^i(^-Xui-i{x)'^ + Xui{x)'^ + Ui{x)-Ui+i{x)^ 

i=l 
i=l 

j 



i=l 
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Rearranging now gives 



(l + A)AQj(x) = ^(7j-,_i-7j-i)(l-Ui(x)) 



1=1 



^^('yj,i - - Ui{x)'^) + - Uj + l{x)). 



1=1 

Recall that jj^ = 7jj+i = 0, and note that 7j^i > 7j^2 > • • • > Jjj = 1- 

As before, we proceed by approximating 1 — Ui{xY by d{l — Ui{x)), for 
i < j. Using first that 1 — Ui{xY < d{l — Ui{x)) for each i, we have 

(l + A)AQj(x) 

j j 

i=l 1=1 
+ (1 - Uj+i{x)) 
j 

= - Ui{x)) [7i,i-i + A(i7j,i+i - {Xd + 1)7^,^] + (1 - Uj+i{x)) 



i=l 



^(1 -ni(x))7j-i 



i=l 



Ad + 1 - 2VAdcos 



J + 1 



+ (1 --"j+ila;)) 



Xd+1- 2VXd 



cos 



vr 



J + 1 



Qj{x) 



n 



+ (1 - 



> -Xd^ + ^2±M_2VXd^ 



n n n 

as claimed. In the last line above, we used (|5.3p . as well as the inequality 
2^/Xdcos{^^/{j + 1)) > V2Xd > 1, valid since Xd > 4. 

For the upper bound, we use the facts that 1 — Uj^i{x) < and 
1 - Ui{x)'^ > d{l - Ui{x)) - (2)(1 - Ui{x)f, to obtain 

(l + A)AQ^-(x) 



< 



Ad + 1 - 2VA(icos 

i 



vr 



j + 1 



Q,{x) 



n 



+ (1 -^^i+i(a^)) 



< -Xd 



Qj+i{x) Pk-i{x) fd\J^ 



Qj{x) 



< -Xd 



Qj{x) 



n 



^ _ J_\ ^ Qj+i{x) ^ Pk-i{x)Qj{x) Jd 

VXd) n n2 V2, 



as claimed. 



□ 
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Next we prove a similar result for the function Pk-i- For this function, 
we need only a fairly crude upper bound on the drift. 

Lemma 5.3. For any state x G , we have 

(1 + X)APk-i{x) < -A 1 - exp — -— + 



{k — l)n J J n 
Proof. The calculation this time is simpler: we have 

APfc_i(x) = (1 + A) nPk-i{Xt+i) - Pk-i{Xt) \Xt = x] 

k-l 

= - ^(Ani_i(x)'^ - \ui{xY - Ui{x) + Ui+i{x)) 

i=l 

= \uk-i{xY - \ -Uk{x) + Ul (x) 

= -A(l - Uk-i{xY) + (1 - Uk{x)) - (1 - ni(x)) 

< -\{l-Uk-i{xf) + {l-Uk{x)). 



We have 1 — Uk{x) < ' and 1 — nfc-i(x) > ^ ^ , so 

1 Pk-i{xy 



Uk-iixr < 1 



< 



exp 



k — 1 n 
dPk^i{x) 



{k-l)n J ' 

which gives the required bound. □ 



6. Hitting Times and Exit Times 

At this point, we begin the proof of Theorem II. 2i Accordingly, from now 
on we fix values of n,d,k £ N, X,e £ (0, 1) such that: 





-A) 


> 


21og^ n. 


(6.1) 




k 


> 


2, 


(6.2) 




£ 


< 


1 

10' 


(6.3) 




e^fd 


> 


150A;, 


(6.4) 




£ 


> 


100A;(1 - A)d^-\ 


(6.5) 






> 


600A;2 log^ n. 


(6.6) 



We explore some consequences of these assumptions. 
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Lemma 6.1. For positive integers n, d, k, and real numbers A G (0, 1), 
e G (0, 1) satisfying \6.1\) to ^6. 6\) above, we also have: 

n > 10^^ (6.7) 

ed > 200klog^n, (6.8) 

log^nfl-A) < , (6.9) 

^ ^ ^ - 80000' ^ ^ 



k 



■log(l-A)-i 



(6.10) 



log d 

e^n(l-A) > 60000fc3 log^ n (6.11) 

en(l-A) > 60000, (6.12) 

k < logn, (6.13) 

d''{l-X) > 2k\ogn, (6.14) 

A'^ > 9/10, (6.15) 

^(Ad7"^(A^ " 2fc' ^^'^^^ 

1=1 1=1 ^ ' 

Proof. Squaring (|6.5p and multiplying by ()6.6p gives 

e^n > 6 X lO^k^log^nd^^-^. 

Using (j6.3p and (j6.2p now yields n/log^n > 9.6 x 10^^, which implies (j6.7p . 

(|6.8p follows from multiplying (|6.ip and (j6.5p . Multiplying by (j6.5p again 
gives > 20000A;2(l - A) log^ nd'^-^ which implies via (lO) . 

(I6.10p is equivalent to d^{l — A) > 1 > d'^^^{l — A), and these inequalities 
are clear from (j6.ip and (j6.5p . 

Multiplying (16. 5j) and (16. 6p gives (16. lip , and the weaker version (16.12p . 

It follows from ([SSI) and (|6l0]l that k < log(l - A)"\ and from (|6J2]l 
that (1 - A)-^ < n. (f03D follows, and also KWi now follows from (|6.ip . 

(|6.15p follows from 



A'^ = (1 - (1 - A))'^ > 1 - A;(l - A) > 1 



lOOd 



where at the end we used ()6.5p and (j6.2p . 

(j6.16p is equivalent to 2k < e{Xd)^, which follows comfortably from (j6.8p . 
Prom (|6.4p and (j6.15p . we have that 

1 ^ /To e ^ e 



x/Ad ~ V 9 150A; " lOO/c' 
which comfortably implies (|6.17p . □ 
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We shall mention explicitly each time we use one of the inequalities ()6.ip - 
()6.17p . Exceptionally, we will not mention ()6.7p ; on several occasions we note 
that an inequality holds for large enough n, and n > 10^^ will always suffice. 

We define a sequence of pairs of subsets of . Each pair consists of a set 
So in which some inequality holds, and a set Si in which a looser version 
of the inequality holds: we also demand that Sq and Si be subsets of the 
previous set TZi in the sequence. Associated with each pair (5o,5i) in the 
sequence is a hitting time 

Ts = inf{t >Tn:Xt£ Sq}, 

where (T^Oi^i) is the previous pair in the sequence, and an exit time 

rj = inf{t >Ts:Xt^ Si}. 

Our aim in each case is to prove that, with high probability, unless the 
previous exit time occurs early, T5 is unlikely to be larger than some 
quantity ms whose order is to be thought of as polynomial in n. More 
precisely, if we start in a state in A{i,g), then the sum of all the ms is of 
order at most the maximum of kn{l — X)~^, gTi{l — A)~^ and in; note that 
k < log n and (l-A)"^ < n (see (l633l) and (KUh ). so if £ and g are bounded 
by a polynomial in n, then so are all the ms- 
Throughout the proof, we set 



We shall also prove that, again with high probability, each exit time is at 
least So, which is larger than the sum of all the terms ms- For convenience, 
we shall not be too precise about our error probabilities, and simply declare 
them all to be at most 

or some small multiple of I/sq. 

We fix, for the moment, a pair of positive real numbers i > k and g > k- 
We set q{£,g) = (23/c + 72g)e-^n{l - A)"^ + Sin, and we make the (mild) 
assumption that i and g are chosen so that q{i,g) < so/2. 

The first pair of sets in our sequence will be as defined earlier: 

^0 = -^oi^ig) = '■ ll^^lloo < £ and ||x||i < gn}, 
Ai = Ai{i,g) = {x : ||x||oo < 3£ and ||x||i < 3gn}, 

and we adopt the hypothesis that Xq = xq almost surely, where xo is a fixed 
state in ^0 = -^o(^)5)) so that Tyi := min{t > : Xt G Aq} = 0. 

For i = i* = log^ n(l - A)"^ and g = g* =2(1- A)-\ Lemma [O] tells us 
that indeed the exit time = mf{t > : Xt ^ is unlikely to be less 
than So- For smaller values of i and g, we do not know this a priori. 

The sets we define are dependent on the chosen values of n, d, k, A and 
e, as well as on i and g- For the most part, we drop reference to this 
dependence from the notation. However, later in the paper we shall need 
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to vary e while keeping all other parameters fixed; in this case, we shall use 
the notation (e.g.) Bq to emphasise the dependence. 
We define: 



Ho 


= {x 


Qkix) < (1 + e)n{l - A)(Ad)'=-i} n Ai, 




Bi 


= {x 


Qk{x) < (1 + 2e)n(l - \){\df-^] n Ai, 




Co 


= {x 


Pk-i{x) < 2kn{l - A)(Ad)'^-2| p 




Ci 


= {x 


Pk~i{x) < 3kn{l - X){Xd)''~^} D Bi, 




Vo 


= {x 


Qk-i{x) < (1 + 4e)n(l - \){\df-^] n Ci, 




Vi 


= {x 


Qk^i{x) < (1 + 5e)n(l - \){\df-^} n Ci, 




£o 


= {x 


Uk+i{x) < e(l — A) and Qk{x) > (1 — 3e)n(l 


- \){\df-^] r\Vi 


£i 


= {x 


Uk+i{x) < e(l — A) and Qk{x) > (1 — 4e)n(l 


- \){\df-^} nVi 



Next we have a sequence of pairs of sets, indexed by j = — 1, . . . , 1: 



Qi = {x 



g{ = {x 



where we declare to be equal to £i. Finally, departing slightly from our 
pattern, we define 

n = no = ni = {x : uk+i{x) = 0} n gl 

The hitting times and exit times are all defined in accordance with the 
pattern given. For instance Tg = inf{i : Xt G Bq}, Tg = inf{t > : Xt ^ 
Bi}, and Tc = 'mf{t > Tb : Xt & Co}. We also set Tgk = Tg and T^^ = tJ, 

in accordance with the notion that the set pair (Q^^^ ,g^~^) follows {£o,£i) 
in the sequence. 

Initially, the sets above all depend on the values of i and g defining the 
initial pair of sets (^O)-^i)) since all the sets are intersected with Ai. How- 
ever, since states in Ti have no queue of length A; + 1 or greater, we have 

^ Ao{k, k) C Ai{l,g) for all i,g > k, and so the set T-L does not depend 
on £ and g, provided these parameters are each at least k. 

We now state a sequence of lemmas. Throughout, we assume that Xq = 
Xo a.s., where xo is an arbitrary state in Ao = Ao{i,g). 

Lemma 6.2. Let ms = 8ke''^n{l — A)~^. 

(1) P(rsATi>mH)<l/so. 

(2) P(Tt <so< Ti) < 1/so. 



■■ [l-(4 



< 



k-j- 1/2 
+ —)e 

k-j -1/2 



k 



l + (4 + 



: [l-(4. 



k-j. 



< 



l + (4 + ^)e 



n(l - X){Xdy~^ < Qj{x) 

^ )e\n{i-x){\dy-']ngi+\ 

n(l - X){Xdy~^ < Qj{x) 

{i-X){xdy-'}ngi+\ 
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Lemma 6.3. Let mc = I2kn{l - A)-^(Ad)^-*^. 

(1) F(TcATl>TB + mc) < I/sq. 

(2) ¥{T^ < so<tI) < 1/so. 

Lemma 6.4. Let mv = 8£-'^n{l - X)^^{Xd)-''/^ . 

(1) ¥{Tv A >Tc + mv) < 1/so- 

(2) P(4 <so< tI) < 1/so. 

Lemma 6.5. Let ms = m£{g) = (13A; + 72g)e~^n{l — \)~^ . 

(1) ¥{Te ATI>Tv + me) < 1/so. 

(2) P(r]<so<4)<l/so. 

Lemma 6.6. Let mg = 32A;£~^n(l — \)~^{\d)~^ . For j = k — 1, . . . ,1, we 

have: 

(1) For j = k-l,...,l, ¥{Tg, A T^.+i > Tg,+, + mg) < I/sq/ 

(2) Forj = k-l,...,l, P(T^, < So < T^,+i) < I/sq. 

Lemma 6.7. Let m-H = mn{£) = n{8£ + 321og^ n). 

(1) ¥(Tn A > Tgi + mn) < 1/so- 

(2) P(ri<so<r^i)<i/so. 

We note here that q{i, g) = {23k + 72g)e-^n{l - A)~^ + Sin is larger than 

all the constants mg, mc, ■ ■ ■ appearing in the lemmas, so these constants 
arc all at most ,so/2. Combining the lemmas gives the following result. 

Proposition 6.8. For any xq & Ao = Ao{i,g), and a copy {Xt) of the 
process with Xq = a.s., we have 

¥{Xt e n for all t G [q{i,g),so]) > 1 - - F{t\ < sq). 

So 

Proof. The idea is that, with high probability, either the chain (Xt) exits 
Ai{i,g) before time sq, or the chain enters each of the sets Bq, . . . , T-Lq in 
turn, within time q{£, g), and does not exit any of the sets Ai, . . . ,7ii before 
time Sq, which is what we need. 

More formally, consider the following list of events concerning the various 
stopping times we have defined: 

El = {4 > so}, E2 = {Tb < me], Es = {T^ > so}, 
E4 = {Tc<mB + mc}, E5 = {T^ > sq}, Eq = {Tv < ms + mc + mv}, 
E7 = {4 > so}, Es = {Ts<mB + ---+ me}. Eg = {tJ > so}, 
Eio = {Tgk-i <mB + ---+ms+mg}, Eu = {T^i^_, > sq}, 

E2k+6 = {Tgi <mB + --- + {k- l)mg}, E2k+7 = {T^i > sq}, 
E2k+8 = {TH<mB + \-{k- l)mg + mn}, £^2fe+9 = {4 > sq}. 
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If E2k+s holds, then 

< mg + mc+ m-D + + {k - l)mg + 

< 8ke-^n{l - X)'^ + 12kn{l - X)-^{Xd)^''' 

+ 8e-^n{l - X)-\Xd)-^/^ + {I3k + 72g)e-^n{l - A)~^ 
+ 32{k - l)ke'^n{l - A)-^(A(i)-^ + n(8£ + 32 log^ n) 

+ 32e log2 n(l - A)) + 725e-in(l - Xy^ + Sin 

< e-^n{l- Xy^{23k + 72g)+8in 

= q{i,g), 

where we used and (l6J5]) to tell us that < 1, and ([63]) 

to show that 32elog2 n(l - A) < 1. Therefore, if ^ = ffj^^ Ej holds, then 
in particular E2k+s and -E'2fc+9 hold, which implies that Xt £ Ti for (?) < 
t < sq. Thus -B is contained in the event {Xt £ % for all t € <?), so]}; 
and it suffices to show that ¥(E) < + F(eI). We write 

2k+9 / i-1 \ 



j=2 \ i=l / 



and now we see that it suffices to prove that each of the terms P {^Ej n 0^=1 
is at most 1/sq. 

We show how to derive the first few of these inequalities from Lemmas 16.21 - 
6.7t first we have 

¥(E^nEi) = P(ri > so, Tb > tub) < F{Tb a ri > tub) < l/so 
by Lemma |6.2( 1). Then we have 

F{Ei DEiD E2) < ¥(e; nEi)= P(r^ < so < ^l) < I/sq 
by Lemma 16.2( 2). Next we have, using the fact that mg + mc < so, 

¥(E^ n n £^2 n Es) < f(e^ nE2n E^) 

= P(r^ > So, Tb < TUB, Tc > mB + mc) 

< ¥{TcATl>mB + mc,TB<mB) 

< ¥{Tc ATl>TB + mc) 

< 1/so, 

by Lemma [6.3l f l). For j = 5, . . . , 2k+9, the upper bound on P (^Ej n flLi^ 
follows either as for j = 3 or as for j = 4: it is important here that 
niB + mc + m-D + ms + {k - l)mg + < q{l, g) < sq. □ 

We now have the following consequence for an equilibrium copy (Yj) of 
the (n, d, A)-supermarket process. 
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Corollary 6.9. F{Yt G V. for all t G [0,so]) > 1 - (4fc + 20)/so > 1 - 
g-iiog2n^ /orn > 1000. 

Proof. Recall the definitions of £*, g* , and Al from Section HI Set 
also q* = q{i*,g*), and note that q* < so/2, with plenty to spare. From 
Lemma Ha we have that P(yo ^ A*q) < ne-'°s'" < 6"^^°^'" = I/sq, since 
n > 5. Also, from Lemma 14.41 for a copy {X^) of the process starting in a 
state X G ^q, we have that P(T^ < sq) < I/sq. We now have 
F{Yt i n for some t G [0, So/2]) 

= P(yt i n for some t G [g*, + So/2]) 

< P(yt ^ n for some t G [g*, + So/2] | G ^S) + IP(^o ^ ^S) 

< P(yt i U for some t G [g*, sq] I G A) + IP(^o ^ ^S) 

< sup P(Xf ^ for some t G [g*, sq]) + — 

2A: + 8 1 1 2A: + 10 

< + - + - = , 

So So So So 

by Proposition ESI Hence FiYt i Ti for some t G [0, sq]) < (4fc + 20) /sq. 

For the final inequality note that (4A; + 20)/so < (41ogn + 20)e~^^°s^" < 
e-3i°g''^ forn > 1000. □ 

We can now use the result above to prove the following more explicit 
version of Proposition 16. 8i 



Theorem 6.10. Suppose that £ and g are at least k, and that q{£,g) < so/2. 
Let xq be any queue-lengths vector in Ao{i,g), and suppose that Xq = xq 
a.s. Then we have 

FiXt G n for all t G W, g), sq]) > 1 

so 

Proof. We apply, successively. Proposition Lemma [4. 3 1 and Corollary 
to obtain that 

F{Xt G n for all t G W,g),so]) 

2k + 8 , t 

> 1 - - P(Ti < so) 

= l_^h±l-f>(3tG[0,so],Xt(^Ai{i,g)) 
So 

> i_^^_^3te[o,so],Yt^Ao{e,g)) 

So 

OjU _|_ o 

> 1 —-F{3tG[0,so],Yt^n) 



> 1 



So 

2A; + 8 4/c + 20 



So So 

as required. □ 
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In the next sections, we shall prove Lemmas 16.21 to 16.71 Then we show 
that T-L C J\f^{n,d, \,k). Theorem 11.21 will then follow from Corollary 16. 9^ 
since so/2 = ^e^i^g"" > e^^^s''^ for n > 18. 

We draw one further conclusion from the results in this section. Suppose 
that (Xf) starts in a state xq in the set 



Then all the hitting times Tg, Tc, Tv, Ts, Tg and are equal to 0. In 
the notation of the proof of Proposition 16.81 this implies that the events Ej 
for j even occur with probability 1. Also, by Lemma 14.41 ^(Ei) < I/sq. So 
following the proof of Proposition 16.81 yields the result below. 

Theorem 6.11. Suppose xq £ X, and Xq = xq a.s. Then 



We shall explore the consequences of this result further in Section [TOj 



In this section, we prove the first three of the sequence of lemmas stated 
in the previous section, and also derive tighter inequalities on the drifts of 
the functions Qj{x) for x E Pi. The proofs of the three lemmas are all 
straightforward applications of Lemma 13.31 ^'^^ ^ similar to one another. 

Proof of Lemma 16.21 

Proof. We apply Lemma [331 We set {(pt) = (J^t), the natural filtration of 
the process, and also: F = Qk, S = Ai, 



h = {l + e){l- X)n{Xd)''-\ P = e{l- X)n{Xd)''-^, 

m = mB = Ske^^n{l - A)~\ s = sq = e^i°s'" and T* = 0. We have p > 
mmQiXdf-^ > 2, by ([61^]) and ([6T5]l . It is also clear that Qk{x) < c := kn 
for any x £ . We note also that takes jumps of size at most 1. 
Suppose now that Qk{x) > h. Then 



fc-i 



X = ^0 n ^0 n Co n Po n £:o n Pi n -Ho. 



F{Xt G n for all t G [0,so]) > 1 - (A; + 5)/so. 



7. Proofs of Lemmas lOl 16.31 and 16.41 




Now we have, using first (16.150 and ()6.14p and then ()6.12p . that 




Thus we have 
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Hence, by Lemma l5. 11 for x with Qk{x) > h, we have 
(l + A)AQfc(x) < (3k{il- X)-Uk+i{x) + Xexp{-dQk{x)/kn)) 

Qk{x) 2 ^ 



{Xdf-^ n \ XdJ ' 

< /3fc ( {1 - X) + X ^^^ ~ -(1 + £)(!- A) fl- 
- ^ V 60000 / ^ ^ \ Xd 



< (1-A) 



^+60U00-^-^+(^ + ^)^ 



< -(1-A)|, 

where at the end we used the fact that < |, which fohows comfortably 
from dEH). So AQfc(x) < -(1 - A)e/4 := -u. Note that mev = 2c. 

We have now verified that the conditions of Lemma 13.31 are satisfied, for 
the given values of the parameters. As in the lemma, we have Tq = T^, 
Ti = inf{i : QkiXt) < h} and T2 = inf{t > Ti : QkiXt) >h + p}. 

It need not be the case that Ti = Tg, since Xt^ need not be in ^1. 
However, we do have Ti A = A and thus 

p(rf5Ari>mB) = P(TiAri>mB) 

< exp(— 

= exp(— efcn(l — A)/16) 

< exp(-3750e~2A:^log2nd''"2) 

< lAo- 

In the penultimate line, we used (|6.11|) : in the final line, all we needed was 
that 3750e~^A;^ log^ nd^~'^ > log^ n, which is true with plenty to spare. 
Also the events T2 < sq < and < sq < coincide, so we have 

nTl<s^<T\) < P(r2<so<Ti) 

< sexp(— yOu) 

= so exp(-e2(l - Xfn{Xdf-^/Q) 

< soexpi-dOk'^log^nd''-'^) 

< 1/so, 

as required, where in the penultimate line we used (j6.6p and (|6.15p . □ 
Proof of Lemma 16.31 

Proof. Again we apply Lemma 13.31 to the Markov process (Xt) with its 
natural filtration. Set F = Pk-i, S = Bi, 

h = 2kn{l - X){Xd)^~^, p = kn{l - X){Xd)^-^, 

m = nic = 12kn{l — A)^^(A(i)^^*'', and s = sq. Set T* = Tq. It is again 
clear from (16.12P that p > 2, and also that Pk-i takes jumps of size at 
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most 1, and that Pk-i{x) < c := kn for all x G Z". Here Tq = Tg, 
Ti = inf{i > Tb : Pk-i{Xt) < h}, and T2 = inf{t > Ti : Pk-i{Xt) >h + p}. 

For X £Bi with > h, we have Qfc(x) < (1 + 2e)n(l - A)(Ad)'^~i 

and so, by Lemma [5T3l 

(l + A)APt_i(i) 



(/c — l)?7- y y n 
< -A (1 - exp (-2d(l - A)(Ad)^-2)) + (1 + 2e)(l - A)(Ad)'^-^ 

Now we have y = 2d{l — A)(Ad)'^~^ < -gg^ < 1/6, by (|6.5p : it is easy to check 
that e"?^ < 1 - |y for < y < 1/6. Also 1 + 2e < 4/3 from (jO]), so 

(l + A)APfc_i(x) < -^(l-A)(Ad)^-i + ^(l-A)(Ad)'=-i 

= -l(l-A)(Ad)^-\ 

We conclude that, for such x, APk-i{x) < -|(1 - X){\d)''~^ := -v. Note 
that mcv = 2c. 

As in the previous lemma, it need not be the case that Ti = Tc, since 
need not be in Bi, so we may have Tc > Ti. However, we do have 
Ti A = Tc A T^. From Lemma [331 we obtain, using also (16. lip . 

F{Tc ATl>TB + mc) = F{Ti ATq > Tb + nic) 

< exp(— f^mc/8) 

= exp(-/fcn(l - X){Xd)^-^ /24) 

< exp (-2500e~^nA;'^ log^ n) 

< l/so- 

Similarly, the events T2 < sq < and < sq < Tg coincide, and so 

F{T^c<so<tI) = F{T2<so<To) 

< soexp{-pv) 

= so exp{-kn{l - Xf{Xdf^-^/6) 

< so exp (^-906^2 (^^)2fc-4^3 ^Qg2 

< l/so- 

as required. Here, we used (|6.6p and ()6.15p . □ 
Sketch of proof of Lemma 16.41 

Proof. The basic plan for this proof is the same as for the previous two 
lemmas, but here we have to take account of the fact that Qfc-i can take 
jumps of size up to (Ad)^*^"^^/^, and accordingly we apply Lemma ISTSl to the 
"scaled" function F{x) = Q'k_^{x) = Qfe_i(x)/(A(i)('=-2)/2_ 
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Apart from this, the proof is identical in structure to that of Lemma 16.3 
and we give only the key calculation. For x £ Ci with Q^„^(x) > h = 
(1 + 4e)n(l - A)(A(i)('=-2)/2^ ^^^^ g^(^) < (1 + 2e)n{l - A)(Ad)*^-^ 
Pk~i{x) < 3kn{l - \){Xd)^-^ and Qfc_i(x) > (1 + 4e)n(l - AKAd)'^-^ 
Thus, by Lemma 15.21 with j = fe — 1, we have 

(l + A)AQfc_i(x) 
< _Ad^^^i^ (i-J-- dPk-i{x) \ ^ Qk{x) 



n V vAc? n J n 

< -Xd{l + 4e)(l - A)(Ad)^-2 fi _ 2 _ ^^^^^ _ 

V V Ad 



+ (l + 2e)(l-A)(Ad) 



k-l 



(1 - X){Xd)''-^ (1 + 4e) ( 1 - ^ - 3kd{l - X){Xd)''-'' ) - (1 + 2e) 



fc-2 



Ad 

< -(1 - A)(Ad)^-i [(1 + 4^)(1 - ^ - 1^) - (1 + 2^) 

< -e(l- A)(A(i)'=~^ 

In the penultimate line, we used (j6.4h and (16.151) . giving that eVXd > 100, 
and also (|6.5p . giving that e > 100A;(1 - A)A^-2^''-i^ ^hus, for such x, the 
drift in the scaled chain satisfies AQ'^_-|^(x) < — ^e(l — A)(Ad)*^/^ := —v. 
Now = 4n, and Q'^_]^(x) < 2n for all x by ()5.2p . 

It is now straightforward to derive the result. □ 

A queue-lengths vector x G T>i satisfies the three inequalities: 

Qk{x) < (l + 2e)n(l-A)(Ad)'=-\ (7.1) 
Pfc_i(x) < 3kn{l- X){Xd)^-^, 

Qk-iix) < (l + 5e)n(l-A)(Ad)^-2; (7.2) 

in fact the second of these is redundant, as Pk-i{x) < Q}^_i[x) < 2n(l — 
A)(A(i)'^~^ for all x G Z". Substituting these bounds into the bounds of 
Lemmas 15.11 and 15.21 we obtain the following. 

Lemma 7.1. For x £ T>i, we have 

Qk{x) 



(l + A)AQfc(x) < /3fc(l- A-nfc+i(x)) 



n{Xd) 



k-i 



+ exp{-dQk{x)/kn) + |(1 - A), 

D 

(l + A)AQ,(x) > /3fc(l - A - uk+i{x)) - ^^'J^fc^.i - |(1 - A), 
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and, for 1 < j < k — 1, 

(1 + A)AQ,(.) < -^d^[l-—)+^^, 

(l + A)Ag,(.) > -A.^(l + -£-)+^2±iM. 

n V 50k/ n 

Proof. For x G Pi, we combine the upper bound for Qk{x) in Lemma |5.1 
with (j7.ip . and obtain 

Qk{x) 



(l + A)Agfc(x) < pk{l-\-Uk+i{x)) 



+ l3k\exp{-dQk{x)/kn) + 



n(Ad)^-i 

2 Qfc(x) 



< - A - 7x^+1(3;)) 



Adn(Ad)'=-i 



n{Xd) 



k-l 



+ exp{-dQk{x)/kn) + ^(1 + 2e)(l - A). 

Au 

Here we used also the facts that /3fc < 1 and A < 1. Using ()6.3p and ()6.15p . 
we have ^(1 + 2s) < 3/d. Also, by 3/d < e^/7500k^ < e/6, which 

gives the required result. 

To obtain the second inequality from its counterpart in Lemma 15.11 we 
need to show that 

From ([12]), the left-hand side is at most (1 + 5ef{l - Xf{Xd)''-'^ < 3(1 - 
A)2(A(i)'=-\ using also Also, from ([63]), we have e > WOk{l - 

X){Xd)''~^ > 18(1 — A) (Ad)*^^"'^. Combining these inequalities gives the result. 

To deduce the upper and lower bounds on (l-l-A)AQj(x) from Lemma lS^ 
we first note that 2/^/Xd < e/50k, by (|6.4p and (j6.15p . This already gives 
the lower bound; for the upper bound, we also observe that 

dPk^ < dQk-ijx) ^ _ ^ 

n n 50k 

using ([72]) and ([63]). □ 



8. Proof of Lemma [6751 

This section is devoted to the rather more complex proof of Lemma 16.5 
First, we prove a statement stronger than part (1) of the lemma. We set 

/C = |a; : Uk+iix) < e(l - A) and Qkix) > n(l - |)(1 - A)(Ad)'=-i} n Pi; 

W,C = mf{t >Tj,:XtG /C}. 
Note that /C C £^q, so to prove Lemma lU^T l) it suffices to prove that 

P(Wyc /\TI>Tv + me) < 1/so. 
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We prove this result on the assumption that = (i.e., that xq £ Aq Ci 
Bq n Co n Vq) . The general case follows immediately by applying the result 
for Tx) = to the shifted process (X^.) = {XT^y+t), using the strong Markov 
property. So our task is to show that F{WicATjy > rrig) < I/sq, where W/c = 
inf{t > : Xt £ /C}, whenever Xq = xq a.s., for any xq £ Aq Ci Bq Ci Cq Ci Vq. 
We define the following further sets, hitting times and exit times. We set 











jx : Uk+i{x) > e(l - A) or Qk{x 


) < n(l - 


j = k,... 


: and VF^fe+i = inf{t > : ^ 
,1, let 






= iyX:Qj{x)<n{l-\){\dy-^{ 


6 




= iyX:Qj{x)<n{l-\){Xdy~^{ 


6 




= inf{t > Wa+^ ■■ Xt £ 4}; 




w"^ - 


= inf{t > Wa :Xt(jtC{)}. 





|)fi-A)fA(i)^-MnPi 

= T^yc A T^. Also, for 



Our goal is to show that F{wj^^^-^ < nig) > 1 — 1/so- If £ K., then 
^'c.k+i = and we are done, so we may assume that xq ^ /C, and hence that 
Xq £ C\^^ . Thus Lemma l6. 5( 1) follows from the proposition below. 

Proposition 8.1. Let xq he any queue-lengths vector in C\'^^ . For a copy 
{Xt) of the (n, d, X)- supermarket process with Xq = xq a.s., we have 

nwl,+, > me) < 1/so. 

For the proof of Proposition 18. 11 we fix a state xq £ C^~^^, and work with 
a copy (Xt) of the (n, d, A)-supermarket process where Xq = xq a.s. 

Our general plan for proving Proposition 18.11 is as follows. We suppose 
that the process (Xt) stays inside = Pi \ /C over the interval [0,m£), 
with the aim of showing that this event has low probability. Observe that, if 
X £ then Uk+i{x) > e(l-A) and Qk{x) > n(l - |)(1 - A)(Ad)'="^ 

This "excess" in u^+i would result in a downward drift in Qk{Xt), so if the 
process does not exit C'^'^^ quickly, then it enters £q quickly, and stays in 
Ci throughout the interval [0,m£): i.e., Wa is small and W^^. is large, with 
high probability. This means that Qk{Xt) maintains a "deficit" compared 
to Qk '■= n{\ — X){Xd)^~^ until time m^. A deficit in Qk{Xt) would lead 
to a deficit in each Qj{Xt) in turn, compared to Qj := n(l — X){Xd)^~^ , 
for j = k — l,k — 2, . . . ,1: each Wa is small, and wj^j is large, with high 
probability. Finally, a deficit in Qi{Xt) compared to Qi = n(l — A) is 
unsustainable, as this would lead to a drift down in the total number of 
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customers over a long enough time interval to empty the entire system of 
customers. This would entail exiting the set Bi 5 C^^^, a contradiction. 

Lemma 8.2. (1) F{Wck A W^^+i > 12A;e"^n(l - A)~^) < I/Usq. 
(2) Fiwj., <me< Wj.,^,) < l/GsQ. 

Proof. We apply Lemma 13.31 to the process (Xt), with its natural filtration, 
and the function F = Qk- We set h = (1 — |)n(l — X){Xd)''^^ and p = 
^n{l - \){\df-^; it follows from (l6TT|) that p > 2. We also set S = 
and T* = 0. We note that Qk{x) < c := kn for every x, and we take 
m = 12k£~^n{l - X)-\ and s = m£ - 1. Then Tq = Wj,^^-,, Ti = mi{t : 
Qk{Xt) < h} and T2 = inf{t > Ti : Qki^t) > h + p}, as in the lemma. 

For X G C'l^^ with Qk{x) > h, we have Uk+i{x) > e(l — A) and x £ Vi. 
So Lemma |7. II applies, and we have 

(1 + X)AQk{x) 

< /3fc(l - A - Uk+iiXt)) - J'j^ll, + eM-dQkix)/kn) + |(1 - A) 



A) 




k 



1 , / (1 - - A)A^-i\ 

< --.(l-A)+exp(^- ' ^' j. 

From ([63]), (jOil) and (f6T5]l . we have that 

(1 - Dd^l - A)A^-i 177 

> log n. 

k - 100 

Also e-Tii°s" < l/2n < (1 - A)e/6 for n > 2, using (l6T2]l . So 
(1 + A)AQfc(x) < -^e(l - A) and AQk{x) < - Je(l - A) := 

3 D 



for such X. Note that mv = 2c. Hence we may apply Lemma [ 

As in earlier lemmas, we have Ti A Wj,^+, = W^k A 1, so we obtain 

P(Tycfc A > m) = P(ri a Tq > m) 

< exp(— v^m/S) 

= exp(-eA;n(l - A)/24) 

< exp(-2500e~2A;''log2n(i''"2) 

< 1/12S0, 

where we used (j6.1ip . 
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Also the events W^^^ < ms < and T2 < m^: < w'^^^j^^ coincide, and 

the second is equivalent to T2 < s < W'^^,.j^-^ (since s = mg — 1). So 

F{wl,<me<wl.,^,) = P(r2 < s < Tq) 

< sexp{—pv) 

= sexp{-e'^n{l- X)^{\d)''-^/U4k) 

< I/6S0, 

as required. Here we used ()6.6p and ()6.15p . □ 

The next lemma states that, if the process stays in some set C\^^ for a 
long time, then it quickly enters the "next" set £q. 

Lemma 8.3. For each j = k — 1, . . . ,1, 

(1) P(W^,+i A Wa > Wa+i + e-^n{l - A)"^) < l/3A:so. 

(2) ¥{WI <m£< Wj.^^,) < l/3kso. 

Proof. (Sketch) This proof is very similar to that of earlier lemmas, and 
we mention only a few points. As in Lemma 16.41 we apply Lemma 13.31 
to the scaled process Q'.{x) = Qj{x)/{\d)^i-^^/^. The key step is to show 

that, for X G C{^^ with Q'j > h = n(l - X){Xd)^^~'^y^{l - | - f), we 
have AQ'j{x) < —^{^ — X){Xd)^^^^^/'^ := —v. The proof now proceeds as 
earlier ones. The calculation for part (2) of the lemma goes as follows, with 
p=2f^n(l-A)(Ad)0-i)/2: 

¥{wj,, <m£< Wl+,) < 

= m£expi-^;^n{l-Xf{Xdy 



< -soexp ( -— log nd^ I 

< l/3kso, 



where we used (j6.6p and (j6.15p . In the case j = 1, this is the place where 
practically the full strength of (j6.6p is used. □ 



We now prove a hitting time lemma for the total number of cus- 

tomers in the system at time t. Let Wm = min{t > W^i : H-'^tlli = 0}. 

Lemma 8.4. 

P(W^i A Wm > Wci + 72g£-^n{l - A)"^) < l/12so. 

Proof. We apply Lemma l3.3l fi) to the chain {Xt), with the filtration (J-t), 
and the function F{x) = \\x\\i, which takes jumps of size at most 1. Since 
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•^i{i,g) 5 we have H-'^olli < c := 3gn. We also set 5 = C\, T* = W^i, 
h = and m = 72ge~'^n{l - A)~^ 

Note that — is equal to +1 if the event at time t is an 

arrival, with probability A/(l + A), and equal to —1 if the event is a potential 
departure from a non-empty queue, with probability ui(Xj)/(l + A), so the 
drift A||x||i is equal to ]-^(A — ui{x)). For x G £}, we have 

Hence, for x £ C\, 

(1 + A)A||x||i = (1 - ui{x)) - (1 - A) < - A), 

and so A||3;||i < —^(1 — A) := —v. Note that vm = 2c. 

Hence we may apply Lemma l3.3l fi). With Tq and Ti as in that lemma, 
we have To = W^^ and Ti = Wm, so we conclude that 

F{WJ,^ A Wm > Wci +m) < exp{-v^m/8) 

= exp{—egn{l — A)/16) 

< exp (^-SlbOe-"^ gk^ log^ n d''"'^ 

< 1/12S0, 

as required. Here we used (|6.1ip . □ 

We now combine Lemmas 18.21 18.31 and 18.41 to prove Proposition 18.11 
Observe that, for a copy (Xt) of the {n, d, A)-supermarket process starting 
in a state xq £ C^'^^, exactly one of the following occurs: 

(a) < ms, 

(b) not (a), and one of W^^, wj,k~i, • • • > is less than mg, 

(c) neither of the above, and W^k > 12A;e~^n(l — A)""*^, 

(d) none of the above, and W^j > W^j+i + e~^n(l — A)^^ for some 
j = k-l,...,l, 

(e) none of the above, and Wm > W^i + 72ge~^n{l — X)~^, 

(f ) none of the above, and Wm < n^e < W^£fe+i • 

Indeed, if none of (a)-(e) occurs, then wj^^+i > ms since (a) fails, and also 

fc-i 

Wm = Wck+Y^i^ci -Wcj+i) + {Wm-Wci) 
i=i 

< I2ke-^n{l - X)-^ + {k- l)e-^n{l - X)-^ + 72ge~^n{l - A)"^ 

< {13k + 72g)e~^n{l- Xy^ 
= ms- 
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We now show that the probabihty of each of (b)-(f) is small. For (b), 
Lemmas 18.2( 2) and 18.3( 2) give that 

¥{WI, A Wj.,., A---AWl<m£< wj..^,) 

k-l 

< Fiwj., <me< M^.+O + J]P(VF^, < me < W^^,) 

< + ^ 



6so 3/cso 
1 

- 2^' 

i.e., the probability of (b) is at most l/2so. The probability of (c) is at most 
l/12.sn by Lemma l8.2( l). The probability of (d) is at most {k—1)^ < l/3so 
by Lemma |8. 3( 1). The probability of (e) is at most l/12so by Lemma 18.41 
Finally, (f) is not possible, since at time Wm there are no customers in the 
system, so Qki^WM) ^ ^'^^^ W_x4 > T^, but also > VF^fc+i since 

£^+1 CViCBi by definition. 

Thus the probability of (a), for a copy of the process starting in a state 
in C'l^^, is at least 

1 ^ 1 1 1 _ 1 1 
2so 12so 3so 12so sq' 

which is what we need to prove Proposition [8Tl and thus also Lemma [6.5( l). 

Now we move to the proof of Lemma [6.5l f2). stating that the exit time 
is large with high probability. There are two things to prove here. The first 
is that, if Xt €z £i, then it is very unlikely that, at time t + 1, a customer 
arrives and creates a queue of length k + 1. The second is that, once Qk{Xt) 
has reached (1 — 3e)n(l — \){\d)^~^ , while Mfc_|_i(Xi) is at most e(l — A), Qk 
is unlikely to "cross down against the drift" to (1 — 4e)n(l — A)(Ad)*^~^. 

For t > 0, let Lt denote the event that, at time t, a customer arrives 
and joins a queue of length at least k (equivalently, the probability that the 
event is an arrival and that all the selected queues have length at least k). 
So Lt is the event that Uj{Xt) > Uj{Xt-i) for some j > k + 1. 



Lemma 8.5. On the event that Xt ^ £-\, we have P(L(+i | J-f) < e 



log n 



Proof. From the definition of Lt, we have ¥{Lt-^i \ J-t) = ^^^^(Xf) < 
UkiXt)'^. For X G £i, we have Qk{x) > (1 - 4e)n(l - X){Xd)''-'^ and 
Qk-i{x) < (1 + 5e)n(l - A)(Ad)'=-2 < ien(l - A)(A(i)'=-\ using with a 
lot to spare. Therefore, by (j5.4p . (j6.3p and (|6.15p . we have 

1 - ukix) >9M- 9]lzM. > (1 _ ]|e)(l - X){\df-' > 1(1 - \)d^-\ 
n n 6 2 
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Hence, from ()6.ip . we have, on the event that Xt G <fi, 
1 \ /I 



nfc(Xi)'^ < (^1 - -(1 - X)d'-'j < exp (^--(1 - A)d'^J < exp(-log^n), 

as required. □ 

Let C/t = inf{t > Ts : Uk+i{Xt) > e(l - A)} and W = inf{t > Tg : 
Qk{Xt) < (1 - 4e)n(l - X){\df-^], and note that tI = tIaU^ A V\ We 
thus have 

P(r] < So < T^) < P([/^ < So A A + p(yt < so A A U^). 

We claim that each of these last two probabilities is at most l/2so- For 
the first, we may apply Lemma 18.51 Observe that, if = i + 1, then the 
event L^j^i occurs. We now have: 

so-l 

¥{U^ < SQ AT^ AV^) = ^¥{U^ =t+l<T^ AV^) 

t=o 

SQ-l 

= F{U^ = t + 1 and Xt G £i) 

SQ-l 

t=0 
t=0 

By Lemma 18.51 each term is at most e~'°^ and so we have 

P(t/t < sqATIaV^) < soe"^°^'" < 1/2S0, 

as claimed. 

To obtain the other required inequality, we apply the reversed version of 
Lemma 13.3( 2). We consider the process (Xt), with its natural filtration, the 
function F = Q^, and the set S = {x : Uk+i{x) < e(l — A)} n Vi. We set 
h = (l-3e)n(l-A)(Ad)'=-i and p = en(l-A)(A(i)^"i > 2. We also set s = sq 
and T* = Tg. We have Tq = mi{t >T£ : Xt^Vi or Uk+i{Xt) > e(l - A)}, 
so that To > A (strict inequality occurs UtIkTs). Also Ti = inf{t > 
Ts : Qk{Xt) >h} = Ts, and T2 = inf{t > Ts : Qk{Xt) < h - p} = . 

Take x £ S with Qk{x) < h. As x £ T>i, we apply Lemma lT.ll to obtain 

il + X)AQkix) > /3fc(l-A-n,+i(x))-^^^^-|(l-A) 
> /3fc(l - A)(l - e) - (1 - A)(l - 36) - ^(1 - A) 





> ^^(1-A), 
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where we also used ()6.16p . This yields AQk{x) > — A) := v, for such x. 
The reversed version of Lemma 13.3( 2) gives that 

P(W < so A A U^) < F{T2 < so A To) 

< soexp{-pv) 

= so exp{-e\{l - \f{\df-^/2) 

< soexp(-270/c2log2nd''"2) 

< 1/2S0, 

as required. Here we used (|6.6|) and (|6.15|) . 
This completes the proof of Lemma 16.51 



9. Proofs of Lemmas [6T6] and [6771 
In this section, we prove the final two of our sequence of lemmas. 
Proof of Lemma 16.61 

Proof. Fix j with 1 < j < k — 1, and consider the state of the process at 
the hitting time Tgj+i . The hitting time Tgj is the first time t > Tgj+i that 



Qj{Xt) lies in the interval between 1 — (4 + 



k-j-l/2- 



n{l-X){Xdy-^ and 



k 

k-j-l/2. 



l + (4 + ^^^)e 



n{l-X){Xdy~'^. Let Bt be the event that QjiXr^^^^) > 
n{l — X){Xdy^^, and Bg be the event that QjiXx^.^-^ ) < 



1 - (4 + ^^^^^)e n(l - X){Xdy-\ 

For part (1) of the lemma, we have to show that, on the event B^, with 
high probability Qj{Xt) enters the interval from above within time mg, and 
also that, on the event Bg, with high probability Qj{Xt) enters the interval 
from below within time mg. These two results are essentially the same, and 
we give details only for the first. Of course, we have nothing to prove on the 
event that Qj{XT is already in the interval. 

We apply Lemma [3.3l fi) to (Xt), with its natural filtration, and the scaled 
function F{x) = Q'-{x) = Qj{x)/{Xd)^^-^'>/^ . We take S = Q{^^ and T* = 
Tgj+i . We set 



h 



l + (4 + 



k-j- 1/2 
k 



)e\n{l- X){Xd)^^-^y^, 



and m = mg = 32k£ ^n(l — A) ^(Ad) ^ . From (|5.2|) . we have that Q'j{x) < 
c := 2n for all x. Also To = T^^+i and Ti = inf{t > Tgj+i : Q'j{Xt) < h}. 
For x G Gi^^ , we have 



Q 



l + (4 + 



k 



k 



1, 



n(l - X){Xdy. 
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(This follows from the specification of QI^^ for j < k — 1, and since 

k- j 



1.) If also > h, we have 

1/2 



£i ^ Si for j = k 

Qj{x)> l + (4 + 

Lemma 17.11 applies since x G Vi, so 

,Qj{x) 



k 



e 



{l + X)AQj{x) 



< 



< 



< 



-Xd- 



n 



V 2bkJ 



l + (4 + 



k 



+ 
1/2 



n{i-\){\dy-^. 

Qj+i{x) 



n 



+ 



l + (4 + 



k 



k 
j - 



I, 



).](l-A)(A.r(l-4) 

[i-\){\dy 



--e(l-A)(Ady, 



and so AQ'j{x) < -^e(l - A)(A(i)(-'+^)/2 — pg^^g ^^^t vmg > 2c. 
Lemma [3^ i) now gives, using (|6.1ip . 

P(Ti A To > Tg,+i + mg) < exp{-v^mg/8) 

= exp{-en{l - X){Xdy /16k) 

< exp ( - 3750e" 2 fc^ log^ n) 

< 1/250- 

On the Tgj -measurable event B^, the stopping times Ti A Tq and Tgj A Tq 
coincide, so we have 

F{Bh n {Tg, A r^,+i > Tg.+i + mg}) < l/2so. 

Essentially exactly the same calculation gives 

¥{Be n {Tg, A r^,.+i > Tg,+i + mg}) < l/2so, 

and part (1) of the lemma now follows, for this value of j. 

To prove part (2) of the lemma, we need to show that, once Xt has 
reached Q^, and while it remains in , the process is unlikely to leave 
the set Ql quickly. There are two separate things to prove: that Qj{Xt) is 



unlikely to cross against the drift from 1 + (4 + 



n(l- A)(Ad) 



to 



1 + (4 H — ^)e n(l — A)(Ad)-' ^ before time sq, and also that Qj{Xt) is 



unlikely to cross against the drift from 



l-{4+!!^i^)e\n{l-\){Xdy'^ to 

1 — (4 + n{l — X){\d)^^^ before time sq. Again, the two calculations 

required here are essentially identical, and we shall concentrate on the first. 

We apply Lemma [3.3( ii). again for the process (Xt) with its natural filtra- 
tion, and the scaled function F{x) = Qj{x)/{\d)^^~^^/'^. We take the same 
values of parameters as above, and additionally set p = ^n{l — X){Xd)^^~^^^^ 



THE SUPERMARKET MODEL WITH ARRIVAL RATE TENDING TO ONE 49 



and s = sq. Here T2 = mi{t > Ti : Q'-{Xt) > h + p}, and we have, using 
(USD and (|6J5]1 . 



= so exp(-e%(l - XyiXdy /I6k) 

( 135 , , 2 

< soexpl — ^felog n 

< 1/2S0. 



Setting U2 = inf{t > Ti : Qj(Xt) < 1 - (4 + n(l - A)(A(i)-'-i}, we 



have, similarly, F{U2 < sq < T'p+i) < l/2so 



The events T2 A U2 < sq < T^j+i and T^j < sq < ^gj+i coincide, so 



P(T^, < So < T^.+O < P(r2 < s < To) + FiU2 <s<To) 



1 1 1 

2so 2so So 



as required for part (2) for this value of j. 



□ 



Proof of Lemma 16.71 



Proof. We first prove part (1). For i = l,...,n, let Ni be the number 
of potential departures from queue i over the time period between Tgi and 
Tgi +m-}{, so Ni is a binomial random variable with parameters (m-^, l/n(l + 
A)). Recall that Lt is the event that, at time t, a customer arrives and joins 
a queue of length k or longer, and observe that 

F{Tn A > Tgi + mn) 

< P( U {Ltr\{Xt-ieG\]))+¥(3i,N,<?,i). 

t = Tgl+l 

Indeed, at time Tgi , the process is in Ai{i, g), and so there is no queue with 
more than 31 customers in it at that time. If there are at least 3i potential 

departures from each queue over the time interval, and Ut=T^i"fi does not 
occur, then by time Tgi + m-^, every queue is reduced to length at most k, 
and no new queue of length A; + 1 is created before Tgi + m-^ . 
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Now let {X[) = {XTg,+t), {T't) = {TTg,+t) and V, = Lr^.+f We have: 

U {Ltn{Xt-iegl})) = F([jmn{xU^Ol}) 



t = Tgl+l t = l 



< Y.F{L',n{xUegl}) 



t=i 



t=l 
< 1/2S0, 

where we used the strong Markov property, and Lemma 18.51 

Recah that m-^ = n{8£ + 321og^n), so that the mean /i of each Ni is 
mn/n{l + X) > 4^ + leiog^n. By with e = 1/4, we have 

F{Ni < 3i) < F{Ni < ^/i) < < g-^iog^n 

for each i. Thus the probabihty that there are fewer than 3£ departures from 
any queue over the interval from Tgi to Tgi + m-^ is at most ne~2 " < 
l/2so, and part (1) follows. 
For part (2), as above we have 

Tgl+SO 

P ( U {LtD {Xt-i G Gl})) < soe-l°s'" < 1/so. 

t = Tgl+l 

Thus F{Ty^ < sq < Tg_^) is at most the probability that Xt exits the set T-Li 

before time A so, necessarily by the creation of a new queue of length 
/c + 1, is at most I/sq, as required. □ 



10. The sets n, I and TV 

One goal of this section is to show that T-L C J\f, thus completing the proof 
of Theorem ll.2l see Corollary 16.91 and the remarks after. We also show that 
the set J\f is "path-connected" , a fact we shall need in the next section. 

We continue to assume that n, d, k, A and e satisfy the hypotheses of 
Theorem 11.21 For this section, it will be important to be explicit about 
the fact that the various sets we have defined depend on the value of the 
parameter e: accordingly, we shall refer to our sets as (e.g.) "H^, and . 
(Note that these sets do not depend on the values of g and £ used in defining 
earlier sets in the sequence.) 
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By definition, the set "H^ consists of tliose queue-lengths vectors x satis- 
fying all of the following: 

\\x\\oo < 31og^n(l - A)"\ llxlli < 6n(l - A)~\ 

Qkix) < (1 + 2£)n(l - X){Xd)''-\ Pk-iix) < Skn{l - A)(AcZ)'=-2, 

Qk-iix) < (1 + 5£)n(l - A)(Ad)*^-2, uk+i{x) < e{l - A), 

Qk{x) > (l-4£)n(l-A)(Ad)*^-\ Uk+i{x) = 0, 

n(l - A)(Ad)J-i (l<i<fc-l), 



Qjix) > 

Qjix) < 



, . k — j 



l + (4 + 



k 

k-j 
k 



)e n{l - X){Xd} 



(1 < j < - 1). 



Evidently many of these conditions arc redundant. The condition that 
Uk+i{x) = implies not only that Uk+i{x) < e(l — A), and that ||a;||oo < 
31og^ n(l — A)~^, but also that ||x||i < kn < 6n{l — X)~^ . The upper bound 
on Pfc_i(x) is implied by Pfc-i(x) < Qk-i{x) < (l+5£)n(l-A)(Ad)''-2. Also, 
the earlier upper bound on Qk-iix) is weaker than the final one. Thus 
consists of those queue-lengths vectors x satisfying all of: 



Uk+iix) = 0, 
Qk{x) < (l + 2e)n(l - A)(Ad) 

Qjix) > 



k-l 



k-j. 



(4+^)£jn(l-A)(Ad)^-i il<j<k), 



Qjix) < 



l + (4+^)e 



n{l - X){Xdy-^ (l<i<fc-l). 



Similarly, consists of those queue-lengths vectors x satisfying: 

||.t|U < log2n(l- A)-i, ||x||i < 2n(l- A)-i, 

Qkix) < (1 + e)n(l - A)(A(^)^-^ Pfc-i(x) < 2kn{l - X){Xd)''-^ 

Qk~iix) < (l + 4£)n(l-A)(Ad)'^-2, Uk+iix) < eil- X), 

Qkix) > (l-3e)n(l-A)(Arf)'^-\ Uk+iix) = 0, 

n(i - x)ixdy-^ 



Qjix) > 



k-j -1/2 
l-(4 + '—]e 



Qjix) < l + (4 + 



k 



k 

i-1/2 



(l<j<A;-l), 
)e\nil - X)iXdy-'^ il<j<k-l). 



Removing redundancies, consists of those vectors x such that: 

Uk+iix) = 0, 
Qkix) < (l + e)n(l-A)(Ad)*^-\ 
Qkix) > (l-3eMl-A)(Ad)'=-S 



Qjix) > [l-(4 + 
Qjix) < [l + (4 + 



k-j -1/2 



k 



k 

■i- 1/2 
k 



n{l-X)iXdy-^ il<j<k-l), 
)e nil - X)iXd)^-^ il<j<k-l). 
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Rather crudely, we have C C X^"^, for any e > 0. 
Now we brmg the sets M'' mto the picture. Recall that 

= {x\ = 0, 

(1 - 5e)(l - \)(\dy-^ < 1 - Uj{x) < (1 + 5e)(l - X){Xdy-^ 
{j = l,...,k)}. 

Lemma 10.1. For any e > 0, W cM" ^ n^^. 

Proof. Take x £ Ti'^: we check that x £ . We do have Uk+i{x) = 0. 
Note that < from ([63]) and (fOSjl . Using also ([53]), and that 

Qj{x) < 2n(l - A)(Ad)J-2 by i^, we have for j = 1, . . . , A; - 1, 



1 — Uj{x) > 



n 



> 



l-(4 + 



2VAd 

- j 
k 



Qj^i{x) 



n 



)e (1 - \){\dy-^ - 4VAd(l - \){\dy 



> (l-A)(Arfr'[l-(5-i).-4^ 

> (l-5e)(l-A)(A(i)^-^ 



We also have 



1 — Uj{x) < 



< 



Qj{x) 



n 



1 + (4 + (1 - A)(Ady-i (j = 1, . . . , A; - 1) 



< (l + 5e)(l - A)(Ad) 

< ^J-<(l + 5e)(l-A)(Ad)'=-\ 



using (|5.16|) . So X G , as required. 

Now take x £ M^; we check that x G H'^'^ . We do have = 0. Also 



Qk{x) < nY^{l-Uj{x)) 

3=1 



< (l + 5e)n(l-A)^(Ady-i 



< (l + 5eMl-A)(Ad^i(l + ^^ 



< (1 + 6e)n(l - A)(Ad) 



k-l 
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where we used ()6.17p . For 1 < j < A; — 1, we have, using (I5.1|) and ()6.17p . 



J 



Qj{x) = ?^y^7j,»(l - Ujjx)) 

i=l 

i-1 

< n(l - Uj{x)) +n^i{Xd)^J-'^/^{l - Ui{x)) 



i=l 

< (1 + 5e)n(l - \){\dy~^ + nA;^(Ad)(j'-*)/2(l + 5e)(l - A)(Ad)*-^ 

i=l 



< n(l-A)(Ad) 



:^ (Ad)0-^)/2 

< {l + 6e)n{l- X){Xdy~\ 

For 1 < j < /c - 1, we have Qj{x) > n(l - Uj(x)) > (1 - 5e)n(l - A)(A(iy-\ 
while also, using (]6.16p . 

Qk{x) > n/?fc(l - tifc(x)) 

> /3fc(l - 5e)n(l - A)(Ad)*^-^ 

> (l-6e)n(l-A)(Ad)'=-^ 

So indeed x G "H^^. □ 

Hence Theorem 16.101 and Corollary 16.91 hold with T-L replaced hy M. More- 
over, we have the following analogue of Theorem 16.111 Here and subse- 
quently, we require that e < 1/60, to ensure that the conditions of Theo- 
rem [L2] are met with e replaced by 6e. 

Theorem 10.2. Take e < 1/60, and xq G . Suppose (Xt) is a copy of 
the {n, d, \)- supermarket process in which Xq = xq almost surely. Then 

F{Xt G n^' for all i G [0, sq]) > 1 - (A; + 5)/so, 

and hence 

F{Xt G M^' for all t G [0, sq]) > 1 - {k + 5)/so. 

Proof. If Xq G AA^ C "H^^ C X^"^, then, by Theorem 16.111 with probability at 
least 1- (A: + 5)/so, for aU times t G [0, sq], G 'H''^ C TV"^, as required. □ 

We say two queue-lengths vectors are adjacent if they differ by one cus- 
tomer in one queue. A path of length m between two vectors x and y is 
a sequence x = xqXi ■ ■ ■ Xm = y of queue-lengths vectors, with each pair 
{xi,Xi+i) adjacent. The path is said to lie in a set S if each Xi is in S. 

Lemma 10.3. Between any two queue-lengths vectors inN^ , there is a path 
of length at most 4n(l — A)(Ad)^~^ lying in A/"^. 
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Proof. For j = 1, . . . , k, set u* = ^ [n{l - (1 - X){Xdy-^)\ . Now set 
V = {z: Uk+i{z) = 0,Uj{z) =u* for j = 1,... . 

In other words, V consists of those queue-lengths vectors z with no queues of 
length greater than k, and such that the number nuj{z) of queues of length 
at least j is equal to nu* = [n(l — (1 — X){Xdy~^)\, for each j = I, . . . ,k. 
We think of V as forming the "centre" of the set J\f^. Our plan is to show 
that every queue-lengths vector in A^^ is joined to some vector in by a 
short path lying entirely in J\f^, and then to show that every two vectors in 
V are connected by a short path, again lying entirely in J\f^. 

Let X be a queue- lengths vector in AA^. We first show that there is a path 
within AA^ of length at most 6fcen(l — X){Xd)^^^ from x to a vector x' in V, 
of the form x = x*-'^"'"^-' • • • x^^-* • • • x*^^"^-* x*-*^^ = x', where: 

(a) Uk+i{y) = for all vectors y on the path, 

(b) for each j = 1, . . . ,k: 

— all the vectors y on the section of the path from x up to x^-'^^) 

satisfy Uj{y) = Uj{x), 

— all the vectors y on the section of the path from x*--'-' to x' satisfy 
Ujiv) = Up 

— on the section of path between x^-'"'"^^ and x*^-'^ the value of Uj{y) 
changes monotonically in steps of size 1/n from uj (x) to u* . 

Such a path will certainly lie in A^^ , since, for each j and each y on the path, 
Uj{y) lies between Uj{x) and u*. 

To establish the existence of such a path, we explain how to construct 
each section individually. For each j, assuming only that x*^-'"'"^) is in A^^, 
we show that there is a sequence of adjacent vectors y, starting with x*^-'^^-', 
so that nuj(y) changes monotonically from nuj(x) to nu* in steps of size 1 
along the sequence, while each other Ui is constant along the sequence. If 
Uj{x^^~^^^) > Uj, the number of queues of length exactly j in x^-'"'"^) is 

n{uj{x^+^) - uj+i{x^^+^^)) 

> n[uj{x^+^) - u*] + [n(l - (1 - X){Xdy-^)\ - n[l - (1 - 5£)(1 - X){Xdy] 

> n[uj{x^+^) - u*], 

so we may form a suitable sequence by taking n[uj{x^~^^) — Uj] queues of 
length exactly j and removing one customer from each of these queues in 
turn. Similarly, if Uj{x^'^^) < Uj, the number of queues of length exactly 
j — 1 in x^-'"'"^^ is 

n[uj-i{x^+^) - Uj{x^^+^^)] 

> n[u* - uj(x^+^)] - Ln(i - (1 - x){Xdy-'^)\ + n[i - (1 + 5£)(i - xyxdy-"^] 

> n[u*-Uj{x^+% 
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SO we may form a suitable sequence by taking n[u* — Uj{x^'^^)] queues of 
length exactly j — 1 and adding one customer to each of these queues in turn. 
Neither of these operations affects Ui, the proportion of queues of length at 
least i, for any value of i other than j. The section of path from x^^~^^^ and 
has length n\uj{x^~^^) — u*\ < 5en(l — \){Xdy^^. 
Thus we can construct a path from x to x' staying within J\f^ , and this 
path has length at most 

k 

^\5en{l - X){Xdy'^] < 6en(l - X){Xd)^'\ 
i=i 

where we used ()6.17p . 

We now show that there is a path of length at most 3n(l — X){Xd)^^^ 
between any two queue-lengths vectors x and x' in the "centre" V of AA^, 

staying within AA"^. This path will be of the form x = X(o) • • • Xi^f.^ = 

x'. Our path will have the following properties, for each j = 1, . . . ,k — 1: 

(a) for every vector y on the path from xq) to x^^f.-^, the set of queues of 
length J — 1 is the same in y as in x'; thus the set of all queues of 
length at most j — 1 is fixed from x^^j-^ to the end of the path 

and hence so is their number n(l — Uj{x')) = n(l — u^)', 

(b) along the path from x to Uj{y) decreases monotonically from 
u* to a value Uj{x(^j_i-^) > u*{l — e); 

(c) along the section of path from 2;(j_i) to xq), Uj{y) stays between 

and u* + 1/n, until it becomes equal to u* at xq). 

With reference to (b) above, we shall actually show that: (b') for each 
j > i, as y goes from and along the path, the value of nuj{y) 

decreases monotonically by at most n(l — u*). Thus, for j = 2, . . . , /c, the 
total decrease in Uj{y) as y goes from x to a^(j-i) is at most 

J2 n{l - u*) < n(l - A) ^(Ad^-i < -en{l - X){Xdy~^ < en{l - uj), 

i=l 1=1 

where we used ()6.17p . So (b') implies (b). 

To construct the section of path between x = X(o) and we consider 
queues of length 0: in both x and x' , the number of these empty queues is 
equal to n(l — u^) = [n(l — A)] . We let Ki^ , • • • , be the queues that are 
empty in x but not in x' , and K^-^ , ■ ■ ■ , K^^. be the queues that are empty in 
x' but not in X - so r < n(l — u^). The section of path from a;(o) to is 
constructed by: adding a customer to queue Ki^ , emptying out queue Ki^ , 
adding a customer to queue Ki^ , emptying out queue Kg^ , and so on. In this 
way, for every vector on this section of path, the number of empty queues is 
within 1 of n(l — n^). Meanwhile, for j > 2, as we go along the path from 
X(o) to the value of Uj{y) may be decreased (since some of the queues 
Ki^ may have length greater than j in X(o) • we decrease the lengths of these 
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queues to 0, without creating any new queues of length at least j), but by 
at most r < n(l — n|), as required. 

We now proceed in the same way for the set of queues of each length 
j = 1,2, ... ,k — I in turn. We describe the construction of the section of 
path from x^^j-^ to In the set of queues of each length less than j 

is the same as in x' , and also we have Uj+i{x(^j-^) < u*^i, by the properties 
of the construction up to this point. Let Ki-^, . . . ,Ki^ be the queues that 
have length exactly j in xq) but are longer in x' , and K^^, . . . ,Kg_^ be the 
queues that have length j in x' but are longer in xq). Note that r — s = 
n[(l — — (1 — u*^i)] > 0, and also that s is at most the number 

of queues of length j in x' , which is at most n(l — u*^-^^). The section of 
path from xq) to a^Q+i) is constructed by: adding a customer to queue 
Ki-^^, reducing the length of queue Ki^ to j, adding a customer to queue 
Ki^, reducing the length of queue Ki^ to j, and so on. At the end, we 
add a customer to each of the remaining queues i^i^+i, . . . in turn. In 
this way, for each intermediate vector y on this section of path, the number 
nuj^i{y) of queues of length at least j + 1 is at least its value nuj^i{x(^j^ 
at the beginning of this section of path, and at most nu*^-^ + 1 (this can 
be achieved if = u*_^_l, in which case nuj+i{y) alternates between 

nu'j_^_-^ and 'nu*_^_l + 1 along the section of path). For h > j + 1, Ufi{y) is 
decreased as go along this section of the path, by at most s < n{l — u*^^-^^), 
as required. 

Along this path from x to x' as a whole, for each queue i, its length 
changes monotonically from x{i) to x'{i). So the total length of the path is 
at most 

n 

^\x{i)-x'{i)\ < 

1=1 



i=l 



^(A:-x(i)) + {k-x'{{}) 

k fc N 

Y^(l-Uk{x)) + J2i^-Uk{x')) 



k 



i=l 
k 



-n 



i=l 



i=l 



i-1 



which is at most 3n(l - \){\df-^ by ((6171) . 

Thus there is a path between any pair of states in of length at most 



3n(l - \){\df-^ + 12en(l - X){\df-^ < 4n(l - \){\df-^ 



as claimed. 



□ 
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11. Rapid Mixing 

Our aims in this section are to prove a variety of results about rapid mix- 
ing of the (n, d, A)-supermarket process. We continue to assume that the 
parameters n, d, k, A and e of the model satisfy the conditions of Theo- 
rem [L2] (or equivalently (I6.1P " (I6.6P ). For this section, we make the stronger 
assumption that e < 1/60, so that (n, d, k, A, 6e) also satisfies the conditions. 

We first consider two copies of the process starting in adjacent states in 
•^oi'^^g), coupled according to the coupling referred to in Lemma HTTl The 
proof partly follows along the lines of the proof of Lemma 2.6 in |5]. 

We set 

q{£,g) = {23k + 72g)e-'^n{l - A)"^ + Sin, 
as in Proposition l6.81 We assume throughout this section that q{i, g) < so/2. 

Lemma 11.1. Let x,y be a pair of adjacent states in ^o(^) §)> with x(jQ) = 
y(jo) — 1 for some queue jo, and x{j) = y{j) for j ^ jq. Consider coupled 
copies {Xf) and {X^) of the {n, d, X)- supermarket process, where Xq = x 
and Xq = y. For all times t > 2q{£,g), we have 

E||Xf-Xf||i = FiX^^Xy) 



< e-3'°s^" + 4exp f ^1^] 

V 3200fc#-in J 



Proof. By Lemma l4.H and X]^ are always neighbours or equal, always 
Xf < Xf , and if for some time s we have X^ = Xg , then = X^ for all 
t>s. Thus in particular E\\Xf - Xf\\i = P(Xf / Xf ). 

Initially, the queue jo is unbalanced, i.e., Xq (jo) / X^(jo), and all other 
queues are balanced. Observe that the index of the unbalanced queue in the 
coupled pair of processes may change over time. Let Wt denote the longer 
of the unbalanced queue lengths at time t, if there is such a queue, and let 
Wt = otherwise. The time for the two coupled processes to coalesce is the 
time T until Wt hits 0. 

Let us first run (X^) and (Xf) together using the coupling. Let 
and denote the times T-^ , as defined in Section [6l for the two copies of 
the process, and set = V T^. By Theorem 16.101 T-^ < q{i,g) with 
probability at least 

^_2(6fc + 28) ^ i_(i2.. + 56)e-i-^^'^ 



So 



> 1 - (121ogn + 56)e" 
3 

where we used (j6.13p : the final inequality holds for n > 10000. 

We now track the performance of the coupling after time T^. If the 
processes have coalesced by time (i.e., if T < T^), then we are done. 
Otherwise, X^, and are still adjacent, and there is some random index 



58 



GRAHAM BRIGHTWELL AND MALWINA J. LUCZAK 



Jo such that the queue Jq is unbalanced, i.e., X^, (Jq) 7^ Xj,, («^o)i and all 
other queues are balanced. Moreover, since = for all x G 7^, we 

have < ^• 

We shall use Lemma 13.41 to give a suitable upper bound on P(VF( > 0). 
The idea is that, since, with high probability, both copies of the process 
remain in % for a long time, the unbalanced queue length Wt will often be 
driven below A;, and then there is a chance of going all the way down to 0. 

For each t > 0, let Bt be the event that X^^Xg £ % for all s with 
< s < t - 1. It follows from Theorem EIO] that ¥(Bi) < (12A; + 56)/so < 
ig-4iog " (|as above), provided t < sq. 

Let be the number of jumps of the longer unbalanced queue length 
in the first r steps after T^. Also set = Nt, the total number of these 
jumps, with At = if T < T^. For j = 1, 2, . . ., let Tj be the time of the jth 
jump after if A^ > j, and otherwise set Tj = V T. Thus, if < T, 
we have < Ti < ■ ■ ■ < T = T/v = Tn+i = • • • . If > T, then all of the 
Tj are equal to T^. 

Let 5*0 = y{Jo) = Wt^1{t^^t}i the longer unbalanced queue length at 
time t = T* if coalescence has not occurred. For each positive integer j, if 
N > let Sj = , which is either or the longer of the unbalanced queue 
lengths at time Tj, immediately after the jth arrival or departure at the 
unbalanced queue. Also, if A^ > j, let Zj be the itl-valued random variable 
Sj — Sj-i. For each non-negative integer j, let fj be the cr-field of 
all events before time Tj+i. Let also Aj be the (/?j-measurable event Bt^^^, 
that is the event that Xg , Xg £ % for each s with < s < Tj^i — 1. 

We shall use Lemma [3^ We shall take the sequences {^j)j>o, iZj)j>o, 
{Sj)j>o and {Aj)j>o as defined above, and we set = k and 5 = 1/ {\d + l). 
Note first, at any time t < T, the probability, conditioned on J^t, of an 
arrival to the longer of the unbalanced queues is at most dX/n{l + A), while 
the conditional probability of a departure from that queue is l/n(l + A). 
Therefore, on the event that A^ > j, the probability, conditioned on ^j-i, 
that the event at time Tj is a departure from the longer unbalanced queue 
is at least 

l/n(l + A) ^ 1 

l/n(l + A) + dA/n(l + A) ~ 1 + dA ~ 
In other words, on the event N > j we have ^{Zj = —1 \ fj-i) > S. 

We now show that, on the event {A^ > j} n Aj^i n {5'j-i > k}, we have 

nzj = -1 1 vj-i) > l- 

To see this, consider a time t > T^. On the event Bf, we have Xf £ T-L Q £1, 
and so, by Lemma 18.51 the conditional probability P(Lt_|_i | J^t) that the 
event at time t + 1 is an arrival to a queue of length k or greater is at 
most e~^°^ In particular, on the event Bt H {VFf_i > k}, the conditional 
probability that the event at time i + 1 is an arrival joining the longer 
unbalanced queue is at most e^^°^ while the conditional probability that 
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the event at time t + 1 is a departure from the longer unbalanced queue is 
l/n(l + A). Therefore, on the event {A^ > j} n Aj-i n {Sj-i > k}, we have 

F(Z =-l\u,-)> V"(-^ + l) > 3 

for n > 10. 

We have now shown that Sm — Sq can be written as a sum Yl^i 
{0, ibl}-valued random variables Zi that satisfy the conditions of LemmaElH 
with ko = k and 6 = l/{Xd + 1). (The argument above establishes this for 
m < N: for m > N, we have set = Sm = 0, which also meets the 
requirements of the lemma.) Note that 

= (Ad+l)'=~i < d''-\l + l/d)'' < d^'-^e^l'^ < rffc-ig^/iso^ < 2d'^-\ 
where we used (j6.4p . Hence, for m > 16 A;, 



( n ^ 0} ^ n ^ '^(^o > L"i/16j ) + 3 exp 

< + 3exp 



i=0 

m 



-m 



200/fc 



m^kd^-^ 

Here P(-) refers to the coupling measure in the probability space of Section 31 
with coupled copies of the process for each possible starting state. 

Let q = q{i, g), take r with 64A;n < r < sq — q and let m = [r/4nj > 16A;. 
Since, at each time after and before T, a jump in the longer unbalanced 
queue occurs with probability at least l/2n while the queue is nonempty, 
we have, by inequality P({T > + r} n {Nr < m}) < e-'^/^^". Also, 

m— 1 



{Nr>m}n\jAin{T^<q}) < 



q+r, 



i=0 



1 -ilog^n 



< -e 4 
- 3 



Now we have that 



¥{T>q + r) < P(T^>g)+P({r>T^+r}n{T^<g}) 

< P(r^ >q) + P({r > + r} n {iv, < m}) 



m— 1 



+ P ({iV, > m} n IJ n {T^ < q}^ 

i=0 

m— 1 m 

+ p({iv, >m}n fl Ainf|{5, /o}). 



4=0 i=l 
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To see this, note that {A^^ > m} n [jT=i{Si = 0} C {T < + r}. Now we 
have 

3 3 
/ r 

+ 3exp 



1600/fe#-i 



n 



2 



< -e-ii°g'" + 4exp 



3 ^ V 1600A;#-in 

provided 64A;n < r < sq — 

If 2g < t < So, then setting r = t — q > t/2 gives 

P,X>.)<|e-l'-" + 4exp(-^^^^), 

which gives the required result. For t > sq, we have 

P(T > t) < P(T > .„) < + 4exp (-^^1^) < .-i'-". 

SO the result holds in this case too. □ 

Theorem 11.2. Let (Xf) and {X^) be two copies of the (n, d, X) -supermarket 
process, starting in states x and y in Ao{i,g)- Then, for t > 2q{£,g), we 
have 

t 



E\\X'{: -X^Wi < 2gn ( e" ^ + 4 exp 



3200fcd^- 



Proof. Given two distinct states x and y in Ao{i,g), we can choose a path 
X = zq, zi, . . . , Zm = y of adjacent states in Ao{i,g) from x down to the 
empty queue-lengths vector and back up to y, where m = ||a;||i + ||y||i < "^gn. 
By Lemma dLll for t > 2q{i,g), 

m— 1 

EWXf-XfWi < ^EIIX^^' -Xf+^lli 

i=0 

< 2gn(e-^^°^^'' + Aexp^ * 



3200A;#-in . 

as required. □ 

We saw in Corollary 16.91 that Yt £ Ao{i,g) with probability at least 1 — 
g-4 log whenever £,g > k, where (Yj) is a copy of the (n, d, A)-supermarket 
process in equilibrium. Thus we have the following corollary. 

Corollary 11.3. Take any £,g > k, and let (Xf) be a copy of the (n, d, A)- 

supermarket process with starting in a state x G .^0(^,5). Also let (Yj) be a 
copy in equilibrium. Then, for t > 2q(£,g), we have 



dTv{C{Xt),C{Yt)) < 2gn ( 26-^1°^''^ + 4exp 



3200A;#-in 
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Proof. The total variation distance is at most the probabihty that Yq ^ 
Ao{i,g), plus the maximum, over all states y G Ao{i,g), of P(Xf / X^)- 
By Corollary 16.91 and Theorem 111.2^ this is at most 

<2,„(2e-5-""+4exp(-55^5i^)). 
as claimed. □ 

This implies Theorem II. 4[ on setting e = 1 /60 (the conclusion is inde- 
pendent of e, and q{i,g) is decreasing in e, so it is best to take the highest 
legitimate value), i = max(A;, ||x||oo) and g = max{k, ||x||i/n), so that 

q{£,g) < 60(23/c + 72(/c + ||x||i/n))n(l-A)"^ + 8(/c+||x||oo)n 
< 6000A;n(l - A)~^ + 4320||x||i(l - A)~^ + 8n||2;||oo, 

as in the statement of the theorem. 

We interpret Theorem 11.41 as saying that we have mixing in time of order 
max{q(£, (7), fe(i'^~^nlogn}, where q{i,g) is bounded as above, or alterna- 
tively of order 

max{A;n(l — X)~^,gn{l — X)^^,in, kd'^^^n log n}. 

The first and last terms here are of similar magnitude: either could be larger. 

Let us indicate briefly why the dependence on £ and g is best possible. 
Suppose first that, for the starting state x, \\x\\ = gn, and that g > 2k. For 
the equilibrium copy, F{\\Yt\\i > kn) < I/sq, so if (iTi/(>C(Xf ), £(yt)) < 1/2, 
then we have 

P(||Xo^||i - ||Xf 111 >{g- k)n) > P(||Xf 111 < kn) > 1/3. 

Now, ||Xq 111 — ||Xf 111 is at most the number of potential departures minus 
the number of arrivals over the interval [0,t], and this number is a sum of t 
Bernoulli random variables of mean — which is well-concentrated 
around ]^t. Therefore, if dTviCiX^), C{Yt)) < 1/2, we must have > 
— k)n, which implies that t > {g — k)n{l — X)~^ > ^gn{l — X)~^. 
Similarly, suppose that, in the initial state x, there is a queue of length at 
least £ > k{l — X)~^ . In order for such a queue to be reduced to length k, 
there must be at least ^£ departures from the queue, and this is unlikely to 
occur before time t = ^£n. 

We now show that mixing actually takes place faster if we start from a 
"good" state, i.e., a state in M = . 

Lemma 11.4. Let x,y be a pair of adjacent states in J\f^ , with x{jQ) = 
yUo) ~ 1 for some queue Jq, and x(j) = y{j) for j / Jq. Consider coupled 
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copies (X'f) and (X^) of the {n, d, \)- supermarket process. For all times 
t >0, we have 

< e-|iog2n + 4exp f ^^^V 

Proof. The proof is nearly identical to that of Lemma 111 .11 Here, instead of 
starting by running the two copies of the process together until some time 
T* , we make use of Theorem 110.2^ which tells us that, with probability at 
most 1 — 2{k + 5)/so, both Xf and X]^ remain within T-l^^ throughout the 
interval < t < sq. We may thus repeat the proof of Lemma 1 1 1 . 1 1 with T* 
and q = q{£, g) replaced by 0, and we obtain the result stated. □ 

Exactly as before, we can use this result to deduce the following. 

Theorem 11.5. Let {Xf) and [X^) he two copies of the (n, d, \)- supermarket 
process with starting states x and y in . Then, for t > 0, we have 

E HXf - < n + 4e,p {-J^f^j) ■ 

Note that the conclusion is independent of e, and the hypothesis is weakest 
when e is as large as possible, namely e = 1 /60. 

Proof. Take any two queue- lengths vectors x and y in . By Lemma 110.31 
there is a path between x = zqZi • • • = y in A/"^ of length m < 4n(l — 
\){Xd)''~^ < n between x and y. The result now follows as in the proof of 
Theorem 111.21 □ 

As before, since Yq lies in T-L^ C J\f^ with probability at least 1 — e"* 
by Corollary 16.91 we may now deduce that the total variation distance 
dTvmX^),C(Xt)) is at most 

whenever x £ . This result, with e = 1/60, is exactly the statement of 
Theorem 11.31 

Theorem 11.31 shows that, from states x £ M^, we have mixing to equi- 
librium in time of order kd^~^n\ogn. We now indicate why this bound 
is approximately best possible, for any value of e such that (n, d. A, k, e) 
satisfies the conditions of Theorem 11.21 where also e < 1/30. 

Note that there is a state z in C CI J\f^^ with Qk{z) < (1 - 
9e)n{l - X){Xd)^-K However, we know from Corollary 16.91 that P(l^ G 
?^^) > 1 — e~ 4 so in order for dTv{^{Xt),Il) to be small, we need that 
Qklxi) > (1 - 5e)n(l - A)(A(i)'=-i with high probability. Set t = n{Xd)''-K 
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For X E we obtain from Lemma [7.1l with a calculation almost exactly 
as in Lemma [521 that 



(l + A)AQfc(x) < (l-A)(l + e/2)--^^ + expMQfc(x)/A;n) 

< (l-A)(l + e/2-(l-e)) + e-Wi°g" 

< 2e{l-X), 

so AQi.(x) < 2e(l — A) also. We know from Theorem 16.111 that . with prob- 
ability at least 1 — (A; + 5)/so, £ T-L^'^ for all s = 0, . . . , i — 1, and we also 
have that Qkix) < kn for every state x. It follows that 

t-i 

¥.Qk{Xt) = + VE(E(AQfc(X,^) I J-,)) 



s=0 



k-i . ^ . ^ N , . ^ + 5 



< (1 - 9e)n(l - \){\df-' + 2et(l - \) + kn 

So 

< {1 - 6e)n{l - X){Xd)^-\ 

A result from [5] (adapted for discrete time) states that, for some absolute 
constant c, for any 1-Lipschitz function /, any starting state z, any t > 
and any u > 0, 

P(|/(Xf) -Ef{Xl)\ >u)< ne-""'/(*+"). 
Applying this with / = Q^, t = n{Xd)^~^ and u = et{l — A), we find that 
nQkiXn > (1 - 5e)n(l - X){Xdf-^) 

< FiQkiXn - EQfc(Xf ) > en{l - A)(Ad)'^-i) 

< ^g--c£2n(l-A)2(Ad)'=-V2 

using (|6.6p and (|6.15p . Therefore the mixing time is at least t = n{Xd)'^^^. 
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